-- Logs begin at Thu 2022-09-08 13:02:28 UTC, end at Thu 2022-09-08 14:13:02 UTC. -- Sep 08 13:43:49.616190 dv-cinder-820027-24-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 13:43:49.624931 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 13:43:49.626965 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 13:43:49 2022] *** Sep 08 13:43:49.626965 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 13:43:49.626965 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 13:43:49.626965 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: nodename: dv-cinder-820027-24-iscsi Sep 08 13:43:49.626965 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: machine: x86_64 Sep 08 13:43:49.626965 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: clock source: unix Sep 08 13:43:49.626965 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: pcre jit disabled Sep 08 13:43:49.626965 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: detected number of CPU cores: 4 Sep 08 13:43:49.626965 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: current working directory: / Sep 08 13:43:49.626965 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: detected binary path: /usr/bin/uwsgi-core Sep 08 13:43:49.627673 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: your processes number limit is 47680 Sep 08 13:43:49.627673 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: your memory page size is 4096 bytes Sep 08 13:43:49.627673 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: detected max file descriptor number: 2048 Sep 08 13:43:49.627673 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: lock engine: pthread robust mutexes Sep 08 13:43:49.627673 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: thunder lock: enabled Sep 08 13:43:49.627673 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 13:43:49.627673 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 13:43:49.666645 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: Python main interpreter initialized at 0x55858053f9c0 Sep 08 13:43:49.666645 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: python threads support enabled Sep 08 13:43:49.666645 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: your server socket listen backlog is limited to 100 connections Sep 08 13:43:49.666645 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: your mercy for graceful operations on workers is 90 seconds Sep 08 13:43:49.666967 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 13:43:49.667057 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: *** Operational MODE: preforking *** Sep 08 13:43:49.667306 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: *** uWSGI is running in multiple interpreter mode *** Sep 08 13:43:49.667306 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: spawned uWSGI master process (pid: 111892) Sep 08 13:43:49.667490 dv-cinder-820027-24-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 13:43:49.668010 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: spawned uWSGI worker 1 (pid: 111893, cores: 1) Sep 08 13:43:49.669770 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: spawned uWSGI worker 2 (pid: 111894, cores: 1) Sep 08 13:43:49.669770 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 13:43:50.325878 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 13:43:50.326445 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 13:43:51.421025 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:43:51.421025 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: from cryptography.utils import int_from_bytes Sep 08 13:43:51.421610 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:43:51.421610 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: from cryptography.utils import int_from_bytes Sep 08 13:43:51.422061 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:43:51.422061 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: from cryptography.utils import int_from_bytes Sep 08 13:43:51.422516 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:43:51.422516 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: from cryptography.utils import int_from_bytes Sep 08 13:43:53.933318 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:43:53.933771 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:43:53.933971 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:43:53.934354 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:43:53.934448 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:43:53.934529 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:43:53.934717 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:43:53.934814 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:43:53.935098 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:43:53.935200 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.935356 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:43:53.935451 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.935726 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.935858 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.936042 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.936137 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.936367 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.936460 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.937205 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.937303 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.937524 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.937611 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.937868 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.937960 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.938192 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.938279 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.938451 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.938537 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.938762 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.938847 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.939074 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.939165 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-24-iscsi {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.939390 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.939483 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.939692 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.940039 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-24-iscsi {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.940253 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.940339 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.940569 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.940678 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.940870 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.940967 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.941185 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.941269 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.941485 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.941616 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.941836 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.942005 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.942144 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.942452 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.942650 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.942754 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.942959 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.943051 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.943257 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.943398 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.943569 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.943697 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.943888 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.944004 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.944201 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.944320 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.944510 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.944628 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.944832 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.944937 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.945138 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.945225 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.945460 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.945624 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-24-iscsi {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.945846 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.945966 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.946194 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-24-iscsi {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.946282 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.946508 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.946594 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.946821 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.946979 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.947135 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.947292 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.947548 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.947646 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.947861 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.947955 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.948169 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.948256 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.948492 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.948587 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.948817 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.948912 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.949129 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.949221 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.949445 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.949538 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.949784 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.949893 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.950086 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.950174 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.950394 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.950488 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.950700 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.950790 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.951008 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.951105 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.951308 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.951401 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.951612 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.951698 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.951860 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.951961 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.952268 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.952843 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.953011 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.953106 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.953311 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.953407 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.953636 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.953755 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.953977 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.954075 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.954228 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.954325 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.954538 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.954624 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.954791 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.954897 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.955114 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.955214 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.955434 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.955521 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.955737 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.955836 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.956043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.956130 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.956347 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.956434 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.956650 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.956749 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.956955 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.957046 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.957255 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.957341 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.957562 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.957659 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.957893 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.957992 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.958215 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.958312 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.958518 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.958612 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.958836 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.958923 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.959144 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.959229 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.959468 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.959557 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.959772 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.959858 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.960101 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.960187 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.960411 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.960499 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.960717 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.960810 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.961033 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.961127 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.961355 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.961450 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.961661 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.961804 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.961992 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.962078 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.962296 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.962385 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.962603 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.962696 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.962913 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.963009 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.963230 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.963315 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.963478 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.963570 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.963779 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.963874 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.964079 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.964173 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.964385 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.964470 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.964686 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.964784 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.964989 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.965085 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.965291 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.965381 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.965590 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.965690 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.965919 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.966009 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.966223 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.966313 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.966526 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.966623 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.966830 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.966915 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.967131 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.967223 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.967435 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.967522 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.967737 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.967829 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.968064 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.968157 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.968368 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.968461 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.968667 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.968762 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.968971 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.969063 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.969278 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.969368 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.969578 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.969674 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.969905 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.970007 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.970208 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.970296 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.970510 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.970596 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.970814 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.970908 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.971114 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.971206 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.971416 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.971510 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.971724 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.971809 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.972024 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.972117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.972325 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.972412 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.972633 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.972726 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.972933 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.973020 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.973238 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.973335 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.973543 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.973628 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.973860 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.973954 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.974165 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.974253 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.974467 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.974560 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.974770 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.974946 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.975071 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.975159 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.975369 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.975463 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.975669 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.975808 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.975970 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.976064 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.976269 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.976364 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.976566 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.976653 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.976864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.976952 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.977160 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.977256 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.977461 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.977546 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.977788 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.977877 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.978098 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.978185 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.978400 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.978494 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.978700 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.978794 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.979007 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.979099 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.979313 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.979399 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.979632 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:43:53.979718 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.979967 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.980055 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.980276 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.980372 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.980605 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.980710 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.980931 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.981017 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.981246 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.981332 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.981554 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.981663 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.981886 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.982020 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.982209 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.982294 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.982514 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.982612 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.982822 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.982908 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.983129 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.983214 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.983463 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.983557 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.983777 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.983882 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.984096 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.984184 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.984406 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.984500 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.984718 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.984812 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.985030 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.985124 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.985336 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.985468 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.985650 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.985769 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.985996 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.986098 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.986311 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.986405 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.986620 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.986715 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.986944 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.987030 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.987256 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.987351 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.987581 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.987675 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.987903 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.987990 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.988219 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.988307 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.988540 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.988629 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.988830 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.988926 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.989134 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.989229 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.989443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.989529 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.989783 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.989891 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.990086 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.990172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.990400 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.990495 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.990706 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.990806 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.991022 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.991152 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.991327 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.991422 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.991633 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.991728 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.991938 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.992032 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.992263 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.992386 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.992547 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.992712 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.992856 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.992954 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.993167 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.993254 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.993489 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.993584 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.993827 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.993915 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.994137 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.994224 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.994462 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.994559 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.994756 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.994844 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.995061 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.995147 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.995366 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.995460 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.995667 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.995757 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.995969 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.996056 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.996269 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.996365 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.996572 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.996660 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.996868 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.996962 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.997173 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.997260 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.997477 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.997563 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.997812 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.997912 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.998141 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.998227 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.998440 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.998535 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.998747 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.998842 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.999568 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.999667 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.999876 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:53.999970 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.000180 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.000276 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.000487 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.000585 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.000792 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.000877 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.001094 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.001237 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.001402 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.001487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.001705 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.001804 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.002032 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.002136 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.002351 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.002436 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.002650 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.002737 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.002952 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.003041 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.003261 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.003402 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.003565 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.003652 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.003878 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.003965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.004188 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.004275 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.004498 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.004583 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.004808 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.004902 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.005114 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.005200 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.005422 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.005518 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.005748 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.005850 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.006110 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.006195 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.006413 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.006509 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.006735 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.006823 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.007057 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.007144 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.007371 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.007474 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.007672 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.007759 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.007977 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.008064 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.008277 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.008376 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.008583 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.008696 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.008876 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.008964 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.009182 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.009275 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.009479 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.009568 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.009800 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.009922 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.010104 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.010206 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.010401 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.010487 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.010701 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.010790 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.011003 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.011088 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.011306 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.011392 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.011604 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.011698 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.011903 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.011998 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.012202 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.012337 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.012500 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.012598 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.012800 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.012888 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.013141 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.013264 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.013436 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.013883 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.013998 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.014131 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.014218 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.014297 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.014420 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.014514 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.014810 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.015392 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.015612 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.015699 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.015926 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.016023 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.016238 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.016325 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.016549 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.016637 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.016869 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.016965 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.017179 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.017265 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.017497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.017589 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.017830 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.017922 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.018154 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.018240 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.018464 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.018549 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.018783 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.018879 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.019090 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.019178 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.019406 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.019491 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.019712 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.019801 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.020033 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.020142 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.020366 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.020456 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.020688 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.020780 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.020997 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.021101 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.021312 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.021420 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.021620 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.021706 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.021950 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.022045 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.022261 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.022430 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.022570 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.022658 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.022878 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.022971 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.023186 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.023286 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.023503 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.023595 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.023813 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.023912 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.024132 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.024226 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.024438 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.024523 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.024754 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.024840 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.025057 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.025153 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.025370 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.025457 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.025672 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.025779 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.026034 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.026129 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.026339 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.026425 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.026651 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.026738 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.026972 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.027063 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.027280 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.027413 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.027590 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.027687 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.027901 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.027995 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.028205 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.028302 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.028511 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.028598 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.028818 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.028916 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.029127 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.029213 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.029433 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.029527 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.029799 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.029893 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.030061 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.030203 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.030395 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.030492 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.030699 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.030785 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.031004 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.031090 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.031306 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.031402 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.031612 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.031697 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.031919 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.032013 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.032225 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.032322 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.032542 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.032636 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.032852 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.032937 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.033153 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.033239 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.033456 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.033542 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.033804 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.033895 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.034113 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.034207 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.034416 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.034511 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.034718 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.034806 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.035019 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.035114 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.035323 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.035416 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.035629 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.035716 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.035950 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.036043 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.036267 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.036361 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.036571 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.036664 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.036881 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.036968 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.037192 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.037281 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.037499 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.037595 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.037828 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.037919 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.038138 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.038234 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.038447 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.038546 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.038754 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.038848 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.039061 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.039159 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.039368 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.039461 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.039675 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.039768 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.039983 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.040070 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.040295 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.040383 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.040599 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.040685 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.040908 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.040995 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.041213 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.041300 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.041512 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.041604 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.041841 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.041943 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.042145 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.042239 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.042456 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.042707 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.042802 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.043037 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.043321 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.043409 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.043652 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.043740 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.043970 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.044065 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.044290 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.044388 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.044619 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.044705 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.044943 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.045041 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.045254 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.045340 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.045558 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.045647 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.045908 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.046001 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.046224 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.046315 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.046528 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.046626 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.046837 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.046931 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.047141 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.047239 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.047444 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.047529 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.047747 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.047840 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.048053 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.048147 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.048353 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.048439 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.048655 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.048743 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.048957 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.049050 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.049258 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.049350 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.049561 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.049646 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.049884 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.049987 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.050194 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.050290 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.050496 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.050587 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.050805 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.050907 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.051110 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.051197 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.051409 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.051494 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.051712 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.051811 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.052013 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.052108 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.052313 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.052410 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.052617 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.052705 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.052959 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.053046 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.053263 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.053350 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.053601 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.053697 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.053932 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.054020 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.054237 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.054337 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.054559 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.054653 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.054863 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.054951 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.055162 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.055257 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.055464 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.055551 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.055764 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.055850 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.056067 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.056165 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.056367 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.056454 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.056675 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.056762 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.056977 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.057071 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.057281 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.057367 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.057587 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.057672 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.057909 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.057998 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.058215 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.058302 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.058516 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.058601 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.058825 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.058914 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.059129 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.059216 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.059428 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.059513 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.059729 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.059818 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.060033 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.060120 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.060336 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.060422 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.060638 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.060726 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.060943 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.061029 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.061240 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.061335 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.062097 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.062205 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.062402 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.062489 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.062705 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.062802 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.063005 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.063100 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.063307 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.063393 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.063610 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.063704 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.063912 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.064000 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.064219 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.064305 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.064521 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.064621 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.065077 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.065345 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.065441 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.065672 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.065960 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.066050 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.066284 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.066370 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.066593 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.066680 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.066913 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.067003 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.067226 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.067315 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.067527 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.067615 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.067834 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.067923 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.068134 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.068222 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.068439 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.068527 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.068739 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.068828 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.069044 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.069131 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.069344 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.069440 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.069645 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.069751 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.069969 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.070068 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.070271 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.070367 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.070571 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.070665 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.070873 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.070966 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.071179 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.071276 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.071479 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.071572 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.071781 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.071868 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.072079 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.072181 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.072402 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.072487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.072707 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.072794 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.073013 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.073101 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.073318 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.073405 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.073649 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.073789 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.073986 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.074074 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.074299 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.074385 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.074607 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.074695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.074919 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.075007 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.075220 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.075307 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.075532 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.075626 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.075884 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.075983 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.076146 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.076242 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.076445 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.076533 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.076746 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.076842 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.077054 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.077209 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.077940 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.078044 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.078250 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.078338 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.078563 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.078663 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.078880 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.078974 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.079193 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.079286 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.079492 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.079579 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.079800 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.079900 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.080108 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.080195 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.080414 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.080502 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.080720 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.080823 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.081026 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.081111 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.081331 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.081417 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.081638 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.081753 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.081976 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.082083 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.082282 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.082367 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.082588 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.082676 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.082891 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.082980 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.083199 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.083287 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.083502 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.083589 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.083804 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.083891 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.084108 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.084194 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.084420 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.084515 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.084718 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.084803 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.085020 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.085113 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.085319 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.085406 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.085626 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.085713 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.085951 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.086052 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.086259 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.086376 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.086564 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.086685 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.086874 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.086995 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.087187 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.087297 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.087604 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.087692 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.087910 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.088053 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.088219 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.088305 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.088526 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.088613 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.088826 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.088919 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.089134 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.089240 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.089448 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.089536 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.089782 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.089884 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.090090 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.090184 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.090451 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.090543 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.090751 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.090839 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.091058 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.091144 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.091379 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.091473 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.091681 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.091769 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.091981 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.092067 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.092278 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.092416 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.092598 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.092686 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.092927 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.093015 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.093232 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.093332 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.093536 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.093645 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.093882 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.093984 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.094188 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.094285 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.094510 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.094674 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.094924 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.095021 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.095238 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.095337 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.095547 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.095635 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.095892 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.095997 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.096215 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.096304 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.096522 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.096657 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.096836 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.096923 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.097145 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.097233 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.097466 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.097554 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.097806 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.097897 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.098117 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.098205 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.098429 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.098517 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.098729 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.098815 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.099049 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.099136 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.099364 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.099451 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.099671 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.099758 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.099975 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.100068 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.100297 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.100386 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.100620 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.100707 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.100934 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.101029 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.101256 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.101343 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.101600 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.101686 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.101928 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.102031 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.102229 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.102317 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.102536 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.102623 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.102839 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.102935 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.103141 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.103228 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.103459 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.103546 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.103763 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.103863 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.104069 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.104157 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.104382 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.104476 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.104689 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.104777 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.104990 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.105077 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.105290 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.105377 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.105601 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.105694 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.105924 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.106010 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.106229 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.106314 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.106535 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.106632 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.106852 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.106941 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.107161 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.107248 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.107461 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.107547 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.107779 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.107868 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.108087 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.108228 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.108913 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.109008 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.109210 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.109298 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.109514 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.109615 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.109857 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.109947 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.110166 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.110254 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.110475 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.110579 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.110783 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.110872 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.111116 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.111202 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.111421 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.111517 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.111744 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.111831 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.112066 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.112152 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.112386 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.112482 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.112695 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.112785 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.113009 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.113096 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.113330 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.113465 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.113630 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.113718 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.113954 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.114045 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.114266 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.114356 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.114569 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.114656 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.114870 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.114959 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.115171 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.115267 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.115475 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.115564 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.115776 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.115907 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.116075 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.116163 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.116376 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.116462 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.116685 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.116782 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.116986 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.117072 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.117293 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.117385 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.117597 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.117694 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.117920 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.118009 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.118223 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.118311 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.118523 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.118620 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.118842 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.118936 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.119147 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.119242 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.119452 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.119548 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.119756 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.119844 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.120075 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.120161 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.120393 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.120482 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.120709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.120797 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.121018 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.121104 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.121330 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.121416 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.121644 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.121754 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.121981 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.122069 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.122293 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.122383 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.122599 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.122739 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.122912 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.123076 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.123223 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.123311 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.123537 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.123623 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.123851 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.124602 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.124709 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.124943 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.125031 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.125257 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.125352 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.125570 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.125857 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.125959 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.126188 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.126283 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.126503 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.126597 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.126815 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.126902 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.127126 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.127214 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.127435 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.127523 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.127743 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.127830 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.128053 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.128147 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.128367 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.128463 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.128679 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.128775 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.128992 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.129088 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.129311 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.129397 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.129625 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.129712 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.129961 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.130062 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.130274 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.130363 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.130602 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.130688 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.130920 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.131010 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.131222 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.131309 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.131535 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.131630 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.131847 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.131935 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.132158 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.132245 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.132468 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.132562 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.132784 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.132871 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.133096 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.133182 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.133407 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.133503 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.133715 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.133829 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.134047 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.134136 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.134360 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.134456 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.134671 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.134765 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.134984 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.135079 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.135296 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.135393 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.135612 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.135699 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.135921 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.136007 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.136233 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.136330 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.136547 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.136635 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.136871 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.137060 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.137192 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.137375 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.137508 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.137709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.137837 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.138125 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.138353 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.138442 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.138668 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.138756 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.139002 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.139097 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.139327 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.139416 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.139676 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.139768 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.139979 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.140079 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.140291 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.140386 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.140598 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.140686 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.140900 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.141000 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.141200 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.141286 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.141510 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.141599 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.141832 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.141938 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.142146 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.142239 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.142452 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.142538 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.142766 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.142979 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.143068 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.143320 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.143407 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.143633 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.143774 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.143959 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.144184 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.144272 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.144527 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.144614 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.144846 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.144935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.145174 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.145261 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.145478 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.145563 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.145808 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.145936 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.146123 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.146209 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.146430 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.146530 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.146732 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.146820 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.147034 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.147156 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.147341 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.147436 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.147648 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.147736 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.147950 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.148037 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.148255 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.148350 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.148553 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.148639 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.148859 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.148951 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.149164 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.149264 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.149464 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.149550 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.149781 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.149871 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.150094 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.150190 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.150399 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.150487 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.150702 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.150788 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.151005 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.151091 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.151308 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.151395 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.151609 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.151694 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.151907 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.151994 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.152210 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.152297 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.152511 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.152601 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.152820 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.152906 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.153124 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.153213 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.153433 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.153528 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.153768 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.153904 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.154069 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.154156 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.154375 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.154482 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.154689 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.154776 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.155003 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.155098 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.155313 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.155436 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.155644 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.155730 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.155950 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.156089 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.156255 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.156350 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.156564 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.156651 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.156887 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.156974 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.157208 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.157412 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.157502 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.157805 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.157904 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.158083 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.158181 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.158415 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.158697 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.158794 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.159031 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.159118 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.159332 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.159419 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.159635 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.159723 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.159957 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.160047 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.160267 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.160357 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.160573 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.160672 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.160879 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.160978 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.161188 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.161276 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.161496 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.161583 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.161829 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.161930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.162140 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.162233 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.162447 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.162535 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.162752 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.162903 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.163057 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.163146 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.163363 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.163456 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.163668 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.163756 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.163972 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.164057 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.164278 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.164364 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.164583 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.164671 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.164893 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.164981 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.165200 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.165287 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.165509 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.165597 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.165847 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.165938 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.166162 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.166261 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.166511 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.166612 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.166820 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.166909 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.167126 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.167222 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.167433 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.167521 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.167743 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.167828 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.168054 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.168150 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.168365 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.168452 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.168667 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.168754 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.168982 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.169313 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.169400 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.169624 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.169711 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.169955 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.170055 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.170275 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.170585 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.170670 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.171434 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.171534 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.171758 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.171852 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.172069 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.172155 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.172383 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.172469 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.172691 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.172778 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.173018 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.173105 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.173329 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.173424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.173653 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.173770 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.173994 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.174082 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.174297 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.174394 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.174600 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.174688 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.174901 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.174988 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.175214 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.175310 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.175530 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.175619 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.175839 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.175926 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.176138 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.176273 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.176439 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.176526 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.176746 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.176906 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.177049 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.177138 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.177351 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.177475 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.177651 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.177757 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.177974 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.178071 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.178277 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.178364 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.178574 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.178667 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.178874 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.178964 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.179173 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.179261 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.179471 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.179568 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.179771 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.179859 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.180068 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.180156 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.180368 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.180462 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.180665 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.180751 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.180962 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.181048 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.181261 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.181355 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.181563 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.181652 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.181890 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.181991 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.182193 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.182295 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.182496 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.182585 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.182801 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.183040 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.183140 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.183230 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.183424 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.183519 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.183739 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.183833 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.184043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.184177 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.184362 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.184450 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.184670 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.184757 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.184978 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.185065 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.185282 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.185368 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.185603 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.185696 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.185934 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.186023 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.186244 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.186375 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.187079 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.187187 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.187397 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.187486 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.187705 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.187792 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.188021 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.188116 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.188332 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.188424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.188644 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.188731 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.188945 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.189044 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.189254 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.189347 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.189566 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.189659 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.190162 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.190256 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.190469 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.190563 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.190775 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.190861 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.191096 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.191184 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.191402 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.191494 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.191708 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.191802 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.192014 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.192110 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.192321 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.192408 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.192627 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.192722 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.192935 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.193021 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.193239 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.193333 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.193546 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.193642 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.193879 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.193972 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.194191 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.194321 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.194498 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.194599 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.194810 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.194897 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.195117 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.195203 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.195429 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.195516 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.195749 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.195835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.196070 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.196156 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.196379 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.196474 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.196702 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.196790 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.197028 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.197113 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.197339 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.197429 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.197655 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.197765 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.197983 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.198071 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.198224 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:43:54.198361 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.198673 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.198985 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.199290 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:43:54.199534 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:43:54.351905 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO dbcounter [None req-93929120-4165-424b-b016-3bd766114e0c None None] Registered counter for database nova_api Sep 08 13:43:54.352108 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO dbcounter [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Registered counter for database nova_api Sep 08 13:43:54.373832 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_db.sqlalchemy.engines [None req-93929120-4165-424b-b016-3bd766114e0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:43:54.376045 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG oslo_db.sqlalchemy.engines [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:43:54.380886 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writer thread running {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:43:54.382492 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writer thread running {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:43:54.438189 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.context [None req-93929120-4165-424b-b016-3bd766114e0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),55c333e2-b047-4e60-8a00-16984688bbb6(cell1) {{(pid=111893) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 13:43:54.438873 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.context [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),55c333e2-b047-4e60-8a00-16984688bbb6(cell1) {{(pid=111894) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 13:43:54.442254 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-93929120-4165-424b-b016-3bd766114e0c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:54.442733 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-93929120-4165-424b-b016-3bd766114e0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:54.443230 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG oslo_concurrency.lockutils [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:54.443708 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG oslo_concurrency.lockutils [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:54.444308 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-93929120-4165-424b-b016-3bd766114e0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:54.445054 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-93929120-4165-424b-b016-3bd766114e0c None None] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:54.445277 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG oslo_concurrency.lockutils [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:54.445500 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-93929120-4165-424b-b016-3bd766114e0c None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:54.446032 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG oslo_concurrency.lockutils [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:54.446540 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG oslo_concurrency.lockutils [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:54.447577 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-93929120-4165-424b-b016-3bd766114e0c None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:54.448484 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG oslo_concurrency.lockutils [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:54.449567 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO dbcounter [None req-93929120-4165-424b-b016-3bd766114e0c None None] Registered counter for database nova_cell0 Sep 08 13:43:54.450494 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO dbcounter [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Registered counter for database nova_cell0 Sep 08 13:43:54.453681 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO dbcounter [None req-93929120-4165-424b-b016-3bd766114e0c None None] Registered counter for database nova_cell1 Sep 08 13:43:54.454491 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO dbcounter [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Registered counter for database nova_cell1 Sep 08 13:43:54.461123 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_db.sqlalchemy.engines [None req-93929120-4165-424b-b016-3bd766114e0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:43:54.462493 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_db.sqlalchemy.engines [None req-93929120-4165-424b-b016-3bd766114e0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:43:54.466605 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG oslo_db.sqlalchemy.engines [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:43:54.468305 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG oslo_db.sqlalchemy.engines [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:43:54.468434 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writer thread running {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:43:54.471642 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writer thread running {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:43:54.605853 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writer thread running {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:43:54.610170 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writer thread running {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:43:54.616248 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO dbcounter [None req-93929120-4165-424b-b016-3bd766114e0c None None] Registered counter for database nova_cell0 Sep 08 13:43:54.619098 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO dbcounter [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Registered counter for database nova_cell0 Sep 08 13:43:54.623342 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_db.sqlalchemy.engines [None req-93929120-4165-424b-b016-3bd766114e0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:43:54.627775 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG oslo_db.sqlalchemy.engines [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:43:54.628759 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writer thread running {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:43:54.632515 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writer thread running {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:43:54.972802 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: WARNING keystonemiddleware.auth_token [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:43:54.973319 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: WARNING keystonemiddleware.auth_token [None req-93929120-4165-424b-b016-3bd766114e0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:43:54.980111 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: WARNING keystonemiddleware.auth_token [None req-93929120-4165-424b-b016-3bd766114e0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:43:54.980244 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: WARNING keystonemiddleware.auth_token [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:43:55.322409 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: WARNING keystonemiddleware.auth_token [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:43:55.322736 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: WARNING keystonemiddleware.auth_token [None req-93929120-4165-424b-b016-3bd766114e0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:43:55.328897 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: WARNING keystonemiddleware.auth_token [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:43:55.329372 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: WARNING keystonemiddleware.auth_token [None req-93929120-4165-424b-b016-3bd766114e0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:43:55.334203 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55858053f9c0 pid: 111894 (default app) Sep 08 13:43:55.335798 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55858053f9c0 pid: 111893 (default app) Sep 08 13:43:55.336485 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:55.337685 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-d58d1f27-8774-4715-953e-04ec93838d07 None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001937 Sep 08 13:43:55.338131 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Thu Sep 8 13:43:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:16.570552 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-93929120-4165-424b-b016-3bd766114e0c None None] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:16.571773 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-93929120-4165-424b-b016-3bd766114e0c None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Sep 08 13:45:16.572185 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:16.583844 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writing DB stats nova_api:SELECT=3 {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:16.584962 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writing DB stats nova_cell0:SELECT=3 {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:16.587176 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writing DB stats nova_cell1:SELECT=3 {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:16.588001 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:17.503561 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-3bc32010-dbde-4f6c-a389-d1ad938ee744 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:17.538304 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-3bc32010-dbde-4f6c-a389-d1ad938ee744 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.959549 Sep 08 13:45:17.539144 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1292 bytes} [Thu Sep 8 13:45:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:20.156009 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-93929120-4165-424b-b016-3bd766114e0c None None] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:20.157028 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-93929120-4165-424b-b016-3bd766114e0c None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 08 13:45:20.162718 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 2/4] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:20 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:20.609909 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-1226077e-4638-49d6-a2eb-4514c6dd9ced admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:20.658207 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-1226077e-4638-49d6-a2eb-4514c6dd9ced admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.494585 Sep 08 13:45:20.658767 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 3/5] 10.222.0.55 () {64 vars in 1283 bytes} [Thu Sep 8 13:45:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:45:20.673167 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writing DB stats nova_api:SELECT=3 {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:20.675939 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writing DB stats nova_cell1:SELECT=3 {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:20.678287 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writing DB stats nova_cell0:SELECT=3 {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:20.679105 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:20.888026 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-ba515f7d-4517-4b31-a548-eb0a2deece78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:20.961428 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-ba515f7d-4517-4b31-a548-eb0a2deece78 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294054 Sep 08 13:45:20.962070 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 3/6] 10.222.0.55 () {64 vars in 1336 bytes} [Thu Sep 8 13:45:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:45:23.532231 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-1226077e-4638-49d6-a2eb-4514c6dd9ced admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:23.533246 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-1226077e-4638-49d6-a2eb-4514c6dd9ced admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 08 13:45:23.533640 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 4/7] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:24.191490 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-dee7f47a-64fa-411a-a522-d3c795583835 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "id": "d1", "rxtx_factor": 1.0}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:24.231441 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-dee7f47a-64fa-411a-a522-d3c795583835 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.691702 Sep 08 13:45:24.231993 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 4/8] 10.222.0.55 () {64 vars in 1283 bytes} [Thu Sep 8 13:45:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:45:24.243957 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-aed57b02-3dc4-4605-aad8-7d49478a26a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:24.287386 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-aed57b02-3dc4-4605-aad8-7d49478a26a1 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046993 Sep 08 13:45:24.288123 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 5/9] 10.222.0.55 () {64 vars in 1336 bytes} [Thu Sep 8 13:45:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:26.922899 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-dee7f47a-64fa-411a-a522-d3c795583835 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:26.923917 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-dee7f47a-64fa-411a-a522-d3c795583835 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 08 13:45:26.924329 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:27.333967 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-f385c9fa-3362-4984-b1ff-3ba109b2828e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "id": "d2", "vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:27.353553 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-f385c9fa-3362-4984-b1ff-3ba109b2828e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422607 Sep 08 13:45:27.354673 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 6/11] 10.222.0.55 () {64 vars in 1283 bytes} [Thu Sep 8 13:45:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:45:27.366660 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-1ea589e0-b66c-47fa-93ed-c281b20e42a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:27.394817 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-1ea589e0-b66c-47fa-93ed-c281b20e42a5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031811 Sep 08 13:45:27.395396 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 6/12] 10.222.0.55 () {64 vars in 1336 bytes} [Thu Sep 8 13:45:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:29.995258 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-f385c9fa-3362-4984-b1ff-3ba109b2828e admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:29.996278 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-f385c9fa-3362-4984-b1ff-3ba109b2828e admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Sep 08 13:45:29.996682 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 7/13] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:30.403532 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-e9771528-deed-463d-b2f3-3c14911fdcba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:30.424522 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-e9771528-deed-463d-b2f3-3c14911fdcba admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.421417 Sep 08 13:45:30.425094 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 7/14] 10.222.0.55 () {64 vars in 1283 bytes} [Thu Sep 8 13:45:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:45:30.438135 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-ba077ade-0af3-4a71-ac94-27ec5cfb2f3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:30.474436 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-ba077ade-0af3-4a71-ac94-27ec5cfb2f3f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040036 Sep 08 13:45:30.475333 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 8/15] 10.222.0.55 () {64 vars in 1336 bytes} [Thu Sep 8 13:45:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:33.111409 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-e9771528-deed-463d-b2f3-3c14911fdcba admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:33.112355 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-e9771528-deed-463d-b2f3-3c14911fdcba admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 08 13:45:33.112761 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 8/16] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:33.554069 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-d3f1d38d-aeb8-4a7b-94d9-3c6ed10b5b4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "id": "d4", "vcpus": 4}} {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:33.574038 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-d3f1d38d-aeb8-4a7b-94d9-3c6ed10b5b4f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454921 Sep 08 13:45:33.574597 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 9/17] 10.222.0.55 () {64 vars in 1283 bytes} [Thu Sep 8 13:45:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:45:33.586480 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-94fae9eb-5c75-4d43-9947-c42d2af9fd5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:33.610492 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-94fae9eb-5c75-4d43-9947-c42d2af9fd5c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027613 Sep 08 13:45:33.611075 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 9/18] 10.222.0.55 () {64 vars in 1336 bytes} [Thu Sep 8 13:45:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:36.493400 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-d3f1d38d-aeb8-4a7b-94d9-3c6ed10b5b4f admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:36.495047 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-d3f1d38d-aeb8-4a7b-94d9-3c6ed10b5b4f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Sep 08 13:45:36.495472 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 10/19] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:45:36.930559 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-a48c0b2d-27d6-476d-aae7-04fdfdd905ba admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:36.959059 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-a48c0b2d-27d6-476d-aae7-04fdfdd905ba admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.456056 Sep 08 13:45:36.959773 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 10/20] 10.222.0.55 () {60 vars in 1292 bytes} [Thu Sep 8 13:45:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:45:39.885781 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-d3f1d38d-aeb8-4a7b-94d9-3c6ed10b5b4f admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:39.886805 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-d3f1d38d-aeb8-4a7b-94d9-3c6ed10b5b4f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 Sep 08 13:45:39.887215 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 11/21] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:40.285129 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-0ad1fb45-380c-42a0-831f-c43ca2ca5155 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:40.317660 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-0ad1fb45-380c-42a0-831f-c43ca2ca5155 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.424145 Sep 08 13:45:40.318253 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 11/22] 10.222.0.55 () {64 vars in 1283 bytes} [Thu Sep 8 13:45:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:45:40.332078 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-9b4abddc-62cb-4913-9ef3-e395c9cbff17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:40.360126 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-9b4abddc-62cb-4913-9ef3-e395c9cbff17 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031705 Sep 08 13:45:40.360699 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 12/23] 10.222.0.55 () {64 vars in 1333 bytes} [Thu Sep 8 13:45:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:42.968981 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-0ad1fb45-380c-42a0-831f-c43ca2ca5155 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:42.970023 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-0ad1fb45-380c-42a0-831f-c43ca2ca5155 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 08 13:45:42.970426 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 12/24] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:43.355968 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-7bb0bc5e-5f70-46ef-a220-deaf39547dc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "swap": 0, "ram": 2048}} {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:43.375567 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-7bb0bc5e-5f70-46ef-a220-deaf39547dc8 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.399060 Sep 08 13:45:43.376111 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 13/25] 10.222.0.55 () {64 vars in 1283 bytes} [Thu Sep 8 13:45:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:45:43.388693 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-2dd627b9-08f2-4c58-bc28-3430b66fc229 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:43.413448 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-2dd627b9-08f2-4c58-bc28-3430b66fc229 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029017 Sep 08 13:45:43.414084 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 13/26] 10.222.0.55 () {64 vars in 1333 bytes} [Thu Sep 8 13:45:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:46.055642 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-7bb0bc5e-5f70-46ef-a220-deaf39547dc8 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:46.057232 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-7bb0bc5e-5f70-46ef-a220-deaf39547dc8 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 08 13:45:46.059915 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 14/27] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:46.617947 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-000a340a-6ba9-4b43-a253-e5d484c71b78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3"}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:46.644019 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-000a340a-6ba9-4b43-a253-e5d484c71b78 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.579697 Sep 08 13:45:46.644675 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 14/28] 10.222.0.55 () {64 vars in 1283 bytes} [Thu Sep 8 13:45:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:45:46.658313 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-89862c00-eb08-4494-b2f4-043dffce2f75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:46.664912 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:46.695012 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-89862c00-eb08-4494-b2f4-043dffce2f75 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040672 Sep 08 13:45:46.695719 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 15/29] 10.222.0.55 () {64 vars in 1333 bytes} [Thu Sep 8 13:45:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:49.314152 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-000a340a-6ba9-4b43-a253-e5d484c71b78 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:49.315738 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-000a340a-6ba9-4b43-a253-e5d484c71b78 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002336 Sep 08 13:45:49.318070 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 15/30] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:49.757697 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-b898a962-de4f-4bf4-8205-76a9f3dff1dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:49.778456 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-b898a962-de4f-4bf4-8205-76a9f3dff1dd admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456246 Sep 08 13:45:49.779381 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 16/31] 10.222.0.55 () {64 vars in 1283 bytes} [Thu Sep 8 13:45:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:45:49.791966 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-fdab0858-e957-48d5-a4b7-385e38f113cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:49.816230 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-fdab0858-e957-48d5-a4b7-385e38f113cc admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028764 Sep 08 13:45:49.817052 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 16/32] 10.222.0.55 () {64 vars in 1333 bytes} [Thu Sep 8 13:45:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:52.445706 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-b898a962-de4f-4bf4-8205-76a9f3dff1dd admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:52.447159 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-b898a962-de4f-4bf4-8205-76a9f3dff1dd admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 08 13:45:52.447841 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 17/33] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:45:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:52.890694 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-b3abf6ce-4f95-4597-981a-575810576886 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:52.902874 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:52.919168 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-b3abf6ce-4f95-4597-981a-575810576886 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.464958 Sep 08 13:45:52.920244 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 17/34] 10.222.0.55 () {64 vars in 1283 bytes} [Thu Sep 8 13:45:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:45:52.932980 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-a11b0593-ca6b-4150-92fe-b912f41e45ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:52.963350 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-a11b0593-ca6b-4150-92fe-b912f41e45ba admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034557 Sep 08 13:45:52.964124 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 18/35] 10.222.0.55 () {64 vars in 1333 bytes} [Thu Sep 8 13:45:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:09.512128 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-b3abf6ce-4f95-4597-981a-575810576886 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:09.513093 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-b3abf6ce-4f95-4597-981a-575810576886 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 08 13:46:09.513526 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 18/36] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:46:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:09.524159 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:09.902008 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-c43220ac-5d42-44fd-8857-3fbb2eb4a964 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:09.920066 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-c43220ac-5d42-44fd-8857-3fbb2eb4a964 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400382 Sep 08 13:46:09.920608 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 19/37] 10.222.0.55 () {60 vars in 1292 bytes} [Thu Sep 8 13:46:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:46:11.232211 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-b3abf6ce-4f95-4597-981a-575810576886 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:11.233216 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-b3abf6ce-4f95-4597-981a-575810576886 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Sep 08 13:46:11.233634 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 19/38] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:46:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:11.750615 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-24bdf40a-033d-452b-854e-a22049b55b0b admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:11.755892 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.wsgi [None req-24bdf40a-033d-452b-854e-a22049b55b0b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-24bdf40a-033d-452b-854e-a22049b55b0b admin admin] Request method failure captured: Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Accept: application/json Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Accept-Encoding: gzip, deflate Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Connection: keep-alive Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Content-Length: 0 Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Host: 10.222.0.55 Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Openstack-Api-Version: compute 2.92 Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Openstack-System-Scope: None Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: User-Agent: python-novaclient Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Auth-Token: gAAAAABjGfIjkfg2go5x28JWskktTYAGGbrimQwm_xUjetT6oobsHJvvT2ZgqbVctTPvll9F7naoRAgEVcLxg2pDQAm1Knk7DbmT-rPfDfM5eA5esRZqyg7O-e4C3a4p7GOUtiL9upPWakYK3k_OsCp9rrn2Fde14rItyo4G-rLf5dvevzdnIBc Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Domain-Id: None Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Domain-Name: None Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Identity-Status: Confirmed Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Is-Admin-Project: True Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Domain-Id: default Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Domain-Name: Default Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Name: admin Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Role: member,admin,reader Sep 08 13:46:11.759189 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Roles: member,admin,reader Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ed368272c55a45f5a7959b08d8add92c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Tenant: admin Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Tenant-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Tenant-Name: admin Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User: admin Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Domain-Id: default Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Domain-Name: Default Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Id: 3709ff21e04749f7aae9073ca845e875 Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Name: admin Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: method: > Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: exception: Flavor 42 could not be found. Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: action_args: {'id': '42'} Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:46:11.760701 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:11.761581 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:11.763172 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-24bdf40a-033d-452b-854e-a22049b55b0b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:46:11.764484 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-24bdf40a-033d-452b-854e-a22049b55b0b admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389513 Sep 08 13:46:11.764484 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 20/39] 10.222.0.55 () {60 vars in 1190 bytes} [Thu Sep 8 13:46:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:46:11.771296 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-fa06c04c-c55e-4642-814b-c9e40885ad3f admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:11.793283 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-fa06c04c-c55e-4642-814b-c9e40885ad3f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026376 Sep 08 13:46:11.793790 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 20/40] 10.222.0.55 () {60 vars in 1210 bytes} [Thu Sep 8 13:46:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:46:11.809069 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-9a54e08e-4086-410e-8264-e4b8e223a189 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:11.831637 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-9a54e08e-4086-410e-8264-e4b8e223a189 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.031766 Sep 08 13:46:11.832200 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 21/41] 10.222.0.55 () {60 vars in 1210 bytes} [Thu Sep 8 13:46:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:46:11.842126 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-34a85469-d8bc-45be-905e-4979af400886 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:11.847355 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.wsgi [None req-34a85469-d8bc-45be-905e-4979af400886 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-34a85469-d8bc-45be-905e-4979af400886 admin admin] Request method failure captured: Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Accept: application/json Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Accept-Encoding: gzip, deflate Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Connection: keep-alive Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Content-Length: 0 Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Host: 10.222.0.55 Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Openstack-Api-Version: compute 2.92 Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Openstack-System-Scope: None Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: User-Agent: python-novaclient Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Auth-Token: gAAAAABjGfIjkfg2go5x28JWskktTYAGGbrimQwm_xUjetT6oobsHJvvT2ZgqbVctTPvll9F7naoRAgEVcLxg2pDQAm1Knk7DbmT-rPfDfM5eA5esRZqyg7O-e4C3a4p7GOUtiL9upPWakYK3k_OsCp9rrn2Fde14rItyo4G-rLf5dvevzdnIBc Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Domain-Id: None Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Domain-Name: None Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Identity-Status: Confirmed Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Is-Admin-Project: True Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Domain-Id: default Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Domain-Name: Default Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Name: admin Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Role: member,admin,reader Sep 08 13:46:11.850704 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Roles: member,admin,reader Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ed368272c55a45f5a7959b08d8add92c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Tenant: admin Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Tenant-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Tenant-Name: admin Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User: admin Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Domain-Id: default Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Domain-Name: Default Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Id: 3709ff21e04749f7aae9073ca845e875 Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Name: admin Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: method: > Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: exception: Flavor 42 could not be found. Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: action_args: {'id': '42'} Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:46:11.852043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:11.852861 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:11.853930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-34a85469-d8bc-45be-905e-4979af400886 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:46:11.855578 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-34a85469-d8bc-45be-905e-4979af400886 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014066 Sep 08 13:46:11.855578 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 21/42] 10.222.0.55 () {60 vars in 1190 bytes} [Thu Sep 8 13:46:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:46:13.064328 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-9a54e08e-4086-410e-8264-e4b8e223a189 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:13.065639 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-9a54e08e-4086-410e-8264-e4b8e223a189 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 08 13:46:13.066092 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 22/43] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:46:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:13.579439 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-c506954f-b165-48fe-86d8-8b667e77731a admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:13.584393 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.wsgi [None req-c506954f-b165-48fe-86d8-8b667e77731a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-c506954f-b165-48fe-86d8-8b667e77731a admin admin] Request method failure captured: Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Accept: application/json Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Accept-Encoding: gzip, deflate Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Connection: keep-alive Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Content-Length: 0 Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Host: 10.222.0.55 Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Openstack-Api-Version: compute 2.92 Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Openstack-System-Scope: None Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: User-Agent: python-novaclient Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Auth-Token: gAAAAABjGfIk36KjDITOMeg5AElo4ESdksI8q-KulgivjhPycb0hqM1lgkalvY25muefZxNCzxLrTHsm7abW0bZ9jot43FBFacsuVGLFBHdXTT3A2cRd-BalMpv2hlxNsgKYwzo599ye-n7gPUsbK2mH471UreWgNzYWuz6o2GMhmmiNgRWzWfQ Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Domain-Id: None Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Domain-Name: None Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Identity-Status: Confirmed Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Is-Admin-Project: True Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Domain-Id: default Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Domain-Name: Default Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Name: admin Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Role: member,admin,reader Sep 08 13:46:13.585965 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Roles: member,admin,reader Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ed368272c55a45f5a7959b08d8add92c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Tenant: admin Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Tenant-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Tenant-Name: admin Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User: admin Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Domain-Id: default Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Domain-Name: Default Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Id: 3709ff21e04749f7aae9073ca845e875 Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Name: admin Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: method: > Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: exception: Flavor 84 could not be found. Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: action_args: {'id': '84'} Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:46:13.587497 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:13.588424 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.589709 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-c506954f-b165-48fe-86d8-8b667e77731a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:46:13.590848 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-c506954f-b165-48fe-86d8-8b667e77731a admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.382927 Sep 08 13:46:13.590848 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 22/44] 10.222.0.55 () {60 vars in 1190 bytes} [Thu Sep 8 13:46:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:46:13.597042 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-29c7038d-2421-4db9-9654-b659e9db3559 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:13.611479 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-29c7038d-2421-4db9-9654-b659e9db3559 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017991 Sep 08 13:46:13.612003 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 23/45] 10.222.0.55 () {60 vars in 1210 bytes} [Thu Sep 8 13:46:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:46:13.621380 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-44f2c9db-4737-438b-ac61-22f266fd522a admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:13.637398 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-44f2c9db-4737-438b-ac61-22f266fd522a admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019943 Sep 08 13:46:13.637971 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 23/46] 10.222.0.55 () {60 vars in 1210 bytes} [Thu Sep 8 13:46:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:46:13.647074 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-969f43e8-f585-42a8-9eb0-7ea6e6184a1f admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:13.651956 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.wsgi [None req-969f43e8-f585-42a8-9eb0-7ea6e6184a1f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-969f43e8-f585-42a8-9eb0-7ea6e6184a1f admin admin] Request method failure captured: Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Accept: application/json Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Accept-Encoding: gzip, deflate Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Connection: keep-alive Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Content-Length: 0 Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Host: 10.222.0.55 Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Openstack-Api-Version: compute 2.92 Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Openstack-System-Scope: None Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: User-Agent: python-novaclient Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Auth-Token: gAAAAABjGfIk36KjDITOMeg5AElo4ESdksI8q-KulgivjhPycb0hqM1lgkalvY25muefZxNCzxLrTHsm7abW0bZ9jot43FBFacsuVGLFBHdXTT3A2cRd-BalMpv2hlxNsgKYwzo599ye-n7gPUsbK2mH471UreWgNzYWuz6o2GMhmmiNgRWzWfQ Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Domain-Id: None Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Domain-Name: None Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Identity-Status: Confirmed Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Is-Admin-Project: True Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Domain-Id: default Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Domain-Name: Default Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Name: admin Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Role: member,admin,reader Sep 08 13:46:13.653443 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Roles: member,admin,reader Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ed368272c55a45f5a7959b08d8add92c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Tenant: admin Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Tenant-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Tenant-Name: admin Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User: admin Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Domain-Id: default Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Domain-Name: Default Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Id: 3709ff21e04749f7aae9073ca845e875 Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Name: admin Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: method: > Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: exception: Flavor 84 could not be found. Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: action_args: {'id': '84'} Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:46:13.655117 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:13.656289 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.657694 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-969f43e8-f585-42a8-9eb0-7ea6e6184a1f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:46:13.658969 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-969f43e8-f585-42a8-9eb0-7ea6e6184a1f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011126 Sep 08 13:46:13.658969 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 24/47] 10.222.0.55 () {60 vars in 1190 bytes} [Thu Sep 8 13:46:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 08 13:46:14.992667 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-44f2c9db-4737-438b-ac61-22f266fd522a admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:14.993683 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-44f2c9db-4737-438b-ac61-22f266fd522a admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 08 13:46:14.994106 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 24/48] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:46:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:15.516348 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-58bedc18-c8cc-4441-a597-75f50016d09d admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:15.522196 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.wsgi [None req-58bedc18-c8cc-4441-a597-75f50016d09d admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-58bedc18-c8cc-4441-a597-75f50016d09d admin admin] Request method failure captured: Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Accept: application/json Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Accept-Encoding: gzip, deflate Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Connection: keep-alive Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Content-Length: 0 Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Host: 10.222.0.55 Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Openstack-Api-Version: compute 2.92 Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Openstack-System-Scope: None Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: User-Agent: python-novaclient Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Auth-Token: gAAAAABjGfImBUxQgdhoMFQj5abCeU4QwiVRqBDcOQGu--Saj88bkoFXFcQJfAygeJfSLrLFXK-gAHaZZH77yQjNniv1f-q_01J56-y29U6W1iMHLJjfVyzH1aYaZ35elB9R0GCCgS1xv9pZYLDc1Tl6ME2q2kouvXYj7xtxXoahBSNLBLKv1Bg Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Domain-Id: None Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Domain-Name: None Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Identity-Status: Confirmed Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Is-Admin-Project: True Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Domain-Id: default Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Domain-Name: Default Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Project-Name: admin Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Role: member,admin,reader Sep 08 13:46:15.523695 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Roles: member,admin,reader Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ed368272c55a45f5a7959b08d8add92c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Tenant: admin Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Tenant-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-Tenant-Name: admin Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User: admin Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Domain-Id: default Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Domain-Name: Default Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Id: 3709ff21e04749f7aae9073ca845e875 Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: X-User-Name: admin Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: method: > Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: exception: Flavor 451 could not be found. Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: action_args: {'id': '451'} Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:46:15.525344 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:15.526423 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: ERROR nova.api.openstack.wsgi Sep 08 13:46:15.527835 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-58bedc18-c8cc-4441-a597-75f50016d09d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:46:15.529084 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-58bedc18-c8cc-4441-a597-75f50016d09d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392639 Sep 08 13:46:15.529084 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 25/49] 10.222.0.55 () {60 vars in 1193 bytes} [Thu Sep 8 13:46:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:46:15.534896 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-06445257-6f64-4a65-9dbf-5472db531428 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:15.550336 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-06445257-6f64-4a65-9dbf-5472db531428 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018993 Sep 08 13:46:15.550859 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 25/50] 10.222.0.55 () {60 vars in 1210 bytes} [Thu Sep 8 13:46:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:46:15.560488 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:15.575251 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018821 Sep 08 13:46:15.575783 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 26/51] 10.222.0.55 () {60 vars in 1210 bytes} [Thu Sep 8 13:46:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:46:15.584536 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-216c989c-65fd-4fac-bcd7-3da0723c94b9 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:15.589930 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.wsgi [None req-216c989c-65fd-4fac-bcd7-3da0723c94b9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-216c989c-65fd-4fac-bcd7-3da0723c94b9 admin admin] Request method failure captured: Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Accept: application/json Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Accept-Encoding: gzip, deflate Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Connection: keep-alive Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Content-Length: 0 Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Host: 10.222.0.55 Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Openstack-Api-Version: compute 2.92 Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Openstack-System-Scope: None Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: User-Agent: python-novaclient Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Auth-Token: gAAAAABjGfImBUxQgdhoMFQj5abCeU4QwiVRqBDcOQGu--Saj88bkoFXFcQJfAygeJfSLrLFXK-gAHaZZH77yQjNniv1f-q_01J56-y29U6W1iMHLJjfVyzH1aYaZ35elB9R0GCCgS1xv9pZYLDc1Tl6ME2q2kouvXYj7xtxXoahBSNLBLKv1Bg Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Domain-Id: None Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Domain-Name: None Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Identity-Status: Confirmed Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Is-Admin-Project: True Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Domain-Id: default Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Domain-Name: Default Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Project-Name: admin Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Role: member,admin,reader Sep 08 13:46:15.591487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Roles: member,admin,reader Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ed368272c55a45f5a7959b08d8add92c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed368272c55a45f5a7959b08d8add92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Tenant: admin Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Tenant-Id: ed368272c55a45f5a7959b08d8add92c Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-Tenant-Name: admin Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User: admin Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Domain-Id: default Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Domain-Name: Default Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Id: 3709ff21e04749f7aae9073ca845e875 Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: X-User-Name: admin Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: method: > Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: exception: Flavor 451 could not be found. Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: action_args: {'id': '451'} Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:46:15.592935 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:15.593722 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: ERROR nova.api.openstack.wsgi Sep 08 13:46:15.594864 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-216c989c-65fd-4fac-bcd7-3da0723c94b9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:46:15.595851 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-216c989c-65fd-4fac-bcd7-3da0723c94b9 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011748 Sep 08 13:46:15.595851 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 26/52] 10.222.0.55 () {60 vars in 1193 bytes} [Thu Sep 8 13:46:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:46:16.798372 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:16.799380 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 08 13:46:16.799772 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 27/53] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:46:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:17.330153 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-35431cd2-dd91-4437-be8d-0c9b339128c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:17.348912 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-35431cd2-dd91-4437-be8d-0c9b339128c1 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.407153 Sep 08 13:46:17.349458 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 27/54] 10.222.0.55 () {64 vars in 1235 bytes} [Thu Sep 8 13:46:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:46:18.586885 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:18.587935 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 08 13:46:18.588335 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 28/55] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:46:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:19.120034 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-01fcbae7-a5f8-4c0a-9e7a-0568e3320077 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:19.139054 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-01fcbae7-a5f8-4c0a-9e7a-0568e3320077 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.414401 Sep 08 13:46:19.139611 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 28/56] 10.222.0.55 () {64 vars in 1235 bytes} [Thu Sep 8 13:46:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:46:20.345688 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:20.346744 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 08 13:46:20.347146 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 29/57] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:46:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:20.858505 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-f64baae0-a566-40d6-b05b-59ae1bff8453 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:20.877805 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-f64baae0-a566-40d6-b05b-59ae1bff8453 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.394585 Sep 08 13:46:20.878345 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 29/58] 10.222.0.55 () {64 vars in 1235 bytes} [Thu Sep 8 13:46:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:46:22.096069 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:22.097068 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 08 13:46:22.097467 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 30/59] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:46:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:22.622108 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-2a664056-783e-4064-a88b-51ac4f2a99fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:22.640501 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-2a664056-783e-4064-a88b-51ac4f2a99fd admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.401139 Sep 08 13:46:22.641043 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 30/60] 10.222.0.55 () {64 vars in 1235 bytes} [Thu Sep 8 13:46:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:46:23.857378 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:23.858424 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 08 13:46:23.858828 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 31/61] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:46:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:24.387353 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-0bca6d71-7d0f-43e0-b210-c6ad97cf5ebe admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:24.407184 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-0bca6d71-7d0f-43e0-b210-c6ad97cf5ebe admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.411675 Sep 08 13:46:24.407725 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 31/62] 10.222.0.55 () {60 vars in 1202 bytes} [Thu Sep 8 13:46:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:47:21.028513 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:21.029523 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-084ed6b2-94db-4d53-9de1-818c24e6d1ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 08 13:47:21.030462 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 32/63] 10.222.0.55 () {54 vars in 931 bytes} [Thu Sep 8 13:47:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:47:21.040831 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:21.421697 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-5f0c04a8-3dd6-4753-9c59-af94816096a6 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:21.442530 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-5f0c04a8-3dd6-4753-9c59-af94816096a6 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406088 Sep 08 13:47:21.443017 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 32/64] 10.222.0.55 () {60 vars in 1292 bytes} [Thu Sep 8 13:47:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:47:21.463913 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writing DB stats nova_api:SELECT=14 {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:21.467656 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-d4a19d6b-4e34-4dff-8b26-85ada2a93b09 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:21.475182 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-d4a19d6b-4e34-4dff-8b26-85ada2a93b09 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012661 Sep 08 13:47:21.475717 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 33/65] 10.222.0.55 () {60 vars in 1283 bytes} [Thu Sep 8 13:47:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:21.487989 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-bcea921e-0066-4c05-b8f9-8f91e6414232 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:21.495261 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-bcea921e-0066-4c05-b8f9-8f91e6414232 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010885 Sep 08 13:47:21.495777 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 33/66] 10.222.0.55 () {60 vars in 1286 bytes} [Thu Sep 8 13:47:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:21.507737 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-75ede32d-2213-4213-bf1f-a79f4bf53508 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:21.514974 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-75ede32d-2213-4213-bf1f-a79f4bf53508 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010845 Sep 08 13:47:21.515481 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 34/67] 10.222.0.55 () {60 vars in 1286 bytes} [Thu Sep 8 13:47:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:21.526537 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-2e283c80-8017-4daa-8b76-faae3879d8ed admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:21.533723 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-2e283c80-8017-4daa-8b76-faae3879d8ed admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010725 Sep 08 13:47:21.534261 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 34/68] 10.222.0.55 () {60 vars in 1283 bytes} [Thu Sep 8 13:47:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:50:25.627106 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-75ede32d-2213-4213-bf1f-a79f4bf53508 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:25.628120 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-75ede32d-2213-4213-bf1f-a79f4bf53508 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 08 13:50:25.628515 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 35/69] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:50:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:50:25.767666 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writing DB stats nova_api:SELECT=6 {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:25.934806 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-cb7732f1-5a01-44b1-a508-b55090993dfa admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:25.939855 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-cb7732f1-5a01-44b1-a508-b55090993dfa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:25.940349 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-cb7732f1-5a01-44b1-a508-b55090993dfa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:25.940774 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-cb7732f1-5a01-44b1-a508-b55090993dfa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:25.941500 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-cb7732f1-5a01-44b1-a508-b55090993dfa admin admin] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:25.942158 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-cb7732f1-5a01-44b1-a508-b55090993dfa admin admin] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:25.942591 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-cb7732f1-5a01-44b1-a508-b55090993dfa admin admin] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:25.975328 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-cb7732f1-5a01-44b1-a508-b55090993dfa admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.208982 Sep 08 13:50:25.975891 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 35/70] 10.222.0.55 () {60 vars in 1193 bytes} [Thu Sep 8 13:50:25 2022] GET /compute/v2.1/os-services => generated 794 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:50:27.076641 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-75ede32d-2213-4213-bf1f-a79f4bf53508 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:27.077644 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-75ede32d-2213-4213-bf1f-a79f4bf53508 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 08 13:50:27.078093 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 36/71] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:50:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:50:27.271592 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-c8e0565a-6a70-4825-966d-ecb6ba5fdff4 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:27.275008 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-c8e0565a-6a70-4825-966d-ecb6ba5fdff4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:27.275487 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-c8e0565a-6a70-4825-966d-ecb6ba5fdff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:27.275920 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-c8e0565a-6a70-4825-966d-ecb6ba5fdff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:27.276633 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-c8e0565a-6a70-4825-966d-ecb6ba5fdff4 admin admin] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:27.277149 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-c8e0565a-6a70-4825-966d-ecb6ba5fdff4 admin admin] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:27.278110 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-c8e0565a-6a70-4825-966d-ecb6ba5fdff4 admin admin] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:27.298393 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-c8e0565a-6a70-4825-966d-ecb6ba5fdff4 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077335 Sep 08 13:50:27.298879 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 36/72] 10.222.0.55 () {60 vars in 1193 bytes} [Thu Sep 8 13:50:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:50:38.784537 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-75ede32d-2213-4213-bf1f-a79f4bf53508 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:38.785551 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-75ede32d-2213-4213-bf1f-a79f4bf53508 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 08 13:50:38.785989 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 37/73] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:50:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:50:38.935149 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writing DB stats nova_cell0:SELECT=4 {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:38.935972 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writing DB stats nova_cell1:SELECT=4 {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:38.936623 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG dbcounter [-] [111893] Writing DB stats nova_api:SELECT=8 {{(pid=111893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:38.988104 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-d3ab3541-c6b9-4977-ab43-b20319cbf7a0 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:38.991522 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-d3ab3541-c6b9-4977-ab43-b20319cbf7a0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:38.991969 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-d3ab3541-c6b9-4977-ab43-b20319cbf7a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:38.992400 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-d3ab3541-c6b9-4977-ab43-b20319cbf7a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:38.993106 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-d3ab3541-c6b9-4977-ab43-b20319cbf7a0 admin admin] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:38.993544 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-d3ab3541-c6b9-4977-ab43-b20319cbf7a0 admin admin] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:38.993990 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-d3ab3541-c6b9-4977-ab43-b20319cbf7a0 admin admin] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:39.019360 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-d3ab3541-c6b9-4977-ab43-b20319cbf7a0 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.089088 Sep 08 13:50:39.019912 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 37/74] 10.222.0.55 () {60 vars in 1193 bytes} [Thu Sep 8 13:50:38 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:50:40.091641 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG nova.api.openstack.wsgi [None req-75ede32d-2213-4213-bf1f-a79f4bf53508 admin admin] Calling method '>' {{(pid=111894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:40.092679 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: INFO nova.api.openstack.requestlog [None req-75ede32d-2213-4213-bf1f-a79f4bf53508 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 08 13:50:40.093081 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: [pid: 111894|app: 0|req: 38/75] 10.222.0.55 () {56 vars in 1074 bytes} [Thu Sep 8 13:50:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:50:40.281725 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG nova.api.openstack.wsgi [None req-47085ce9-d00c-4974-b11b-8c4a6f70e481 admin admin] Calling method '>' {{(pid=111893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:40.285110 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-47085ce9-d00c-4974-b11b-8c4a6f70e481 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:40.285612 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-47085ce9-d00c-4974-b11b-8c4a6f70e481 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:40.286056 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-47085ce9-d00c-4974-b11b-8c4a6f70e481 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:40.286765 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-47085ce9-d00c-4974-b11b-8c4a6f70e481 admin admin] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:40.287205 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-47085ce9-d00c-4974-b11b-8c4a6f70e481 admin admin] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:40.287615 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: DEBUG oslo_concurrency.lockutils [None req-47085ce9-d00c-4974-b11b-8c4a6f70e481 admin admin] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:40.309529 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: INFO nova.api.openstack.requestlog [None req-47085ce9-d00c-4974-b11b-8c4a6f70e481 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.079017 Sep 08 13:50:40.310227 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: [pid: 111893|app: 0|req: 38/76] 10.222.0.55 () {60 vars in 1193 bytes} [Thu Sep 8 13:50:40 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:51:39.996515 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: Thu Sep 8 13:51:39 2022 - graceful shutdown triggered... Sep 08 13:51:39.996755 dv-cinder-820027-24-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 08 13:51:39.997468 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: Gracefully killing worker 2 (pid: 111894)... Sep 08 13:51:39.997985 dv-cinder-820027-24-iscsi devstack@n-api.service[111893]: Gracefully killing worker 1 (pid: 111893)... Sep 08 13:51:40.127821 dv-cinder-820027-24-iscsi devstack@n-api.service[111894]: DEBUG dbcounter [-] [111894] Writing DB stats nova_api:SELECT=4 {{(pid=111894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:40.997664 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: worker 1 buried after 1 seconds Sep 08 13:51:40.998248 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: worker 2 buried after 1 seconds Sep 08 13:51:40.998248 dv-cinder-820027-24-iscsi devstack@n-api.service[111892]: goodbye to uWSGI. Sep 08 13:51:40.999301 dv-cinder-820027-24-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 08 13:51:41.000406 dv-cinder-820027-24-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 08 13:51:41.003251 dv-cinder-820027-24-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 13:51:41.016597 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 13:51:41.019208 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 13:51:41 2022] *** Sep 08 13:51:41.019208 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 13:51:41.019208 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 13:51:41.019208 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: nodename: dv-cinder-820027-24-iscsi Sep 08 13:51:41.019208 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: machine: x86_64 Sep 08 13:51:41.019208 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: clock source: unix Sep 08 13:51:41.019208 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: pcre jit disabled Sep 08 13:51:41.019208 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: detected number of CPU cores: 4 Sep 08 13:51:41.019208 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: current working directory: / Sep 08 13:51:41.019208 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: detected binary path: /usr/bin/uwsgi-core Sep 08 13:51:41.019208 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: your processes number limit is 47680 Sep 08 13:51:41.020080 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: your memory page size is 4096 bytes Sep 08 13:51:41.020080 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: detected max file descriptor number: 2048 Sep 08 13:51:41.020080 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: lock engine: pthread robust mutexes Sep 08 13:51:41.020080 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: thunder lock: enabled Sep 08 13:51:41.020080 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 13:51:41.020080 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 13:51:41.059031 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: Python main interpreter initialized at 0x55f1e08fc9c0 Sep 08 13:51:41.059031 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: python threads support enabled Sep 08 13:51:41.059031 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: your server socket listen backlog is limited to 100 connections Sep 08 13:51:41.059031 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: your mercy for graceful operations on workers is 90 seconds Sep 08 13:51:41.059457 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 13:51:41.059457 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: *** Operational MODE: preforking *** Sep 08 13:51:41.059677 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: *** uWSGI is running in multiple interpreter mode *** Sep 08 13:51:41.059677 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: spawned uWSGI master process (pid: 126902) Sep 08 13:51:41.059911 dv-cinder-820027-24-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 13:51:41.061047 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: spawned uWSGI worker 1 (pid: 126919, cores: 1) Sep 08 13:51:41.061047 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: spawned uWSGI worker 2 (pid: 126920, cores: 1) Sep 08 13:51:41.061047 dv-cinder-820027-24-iscsi devstack@n-api.service[126902]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 13:51:41.720561 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 13:51:41.736824 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 13:51:42.871330 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:51:42.871330 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: from cryptography.utils import int_from_bytes Sep 08 13:51:42.872011 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:51:42.872011 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: from cryptography.utils import int_from_bytes Sep 08 13:51:42.901690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:51:42.901690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: from cryptography.utils import int_from_bytes Sep 08 13:51:42.902323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:51:42.902323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: from cryptography.utils import int_from_bytes Sep 08 13:51:45.313950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:51:45.314510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:51:45.314783 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:51:45.315116 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:51:45.315368 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:51:45.315762 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.316087 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.316409 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.316728 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.317061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.317372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.317698 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.318806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.318806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.318806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.319043 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.319430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-24-iscsi {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.319759 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.320075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.320388 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.320714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.321021 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.321343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.321652 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.322185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.323664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.323664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.323664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.323664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.324032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.324263 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.324486 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.324806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.325125 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.325441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.325892 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-24-iscsi {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.326210 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.326518 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.326842 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.327267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.327575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.328422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.328739 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.329061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.329384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.329703 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.330058 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.330366 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.330696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.331002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.331487 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.331666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.331938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.332243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.332553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.332798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.333294 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.334082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.334411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.334739 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.334994 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.335241 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.335567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.335890 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.336199 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.336509 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.336816 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.337122 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.337430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.337750 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.338064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.338370 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.338690 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.339005 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.339327 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.339632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.339950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.340359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.340612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.340917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.341257 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.341572 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.341905 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.342221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.342539 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.342848 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.343153 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.344027 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.344349 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.344687 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.344986 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.345235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.345535 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.345863 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.346180 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.346483 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.346786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.347090 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.347387 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.347690 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.347992 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.348294 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.348597 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.348899 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.349203 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.349503 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.349833 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.350141 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.350446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.350768 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.351087 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.351391 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.351693 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.351996 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.352299 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.352617 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.352920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.353221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.353541 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.353876 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.354176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.354492 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.354796 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.355098 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.355413 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.355710 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.356013 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.356326 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.356629 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.356959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.357294 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.357515 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.357841 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.358145 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.358443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.358741 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.359577 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.359893 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.360212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.360529 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.360831 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.361132 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.361451 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.361816 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.362148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.362492 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.362805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.363137 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.363461 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.363775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.364088 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.364399 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.364723 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.365030 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.365413 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.365674 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.365992 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.366309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.366634 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.366949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.367258 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.367573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.367881 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.368195 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.368517 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.368839 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.369148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.369491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.369860 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.370177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.370507 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.370836 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.371143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.371521 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.371881 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.372220 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.372537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.372847 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.373164 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.373473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.373818 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.374130 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.374439 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.374810 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.375122 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.375431 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.375769 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.376082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.376401 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.376715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.377027 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.377343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.377653 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.377983 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.378291 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.378593 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.378894 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.379195 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.379502 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.379803 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.380122 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.380453 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.380757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.381084 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.381390 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.381696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.382028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.382335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.382637 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.382945 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.383251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.383553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.383873 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.384180 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.384482 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.384800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.385102 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.385405 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.385719 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.386048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.386356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.386512 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:51:45.387004 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.387162 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:51:45.387306 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.387460 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:51:45.387616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.387616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.387902 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:51:45.388053 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.388198 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:51:45.388342 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.388503 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.388649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.388801 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.388964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.389118 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.389270 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.389425 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.389569 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.389721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.389923 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.390069 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.390746 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.390846 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.390948 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.391047 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.391122 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.391274 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.391454 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.391609 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.392473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.392660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.392818 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.392818 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.393117 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-24-iscsi {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.393262 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.393406 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.393549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.393701 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.393913 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.394062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.394205 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.394357 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.394501 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.394645 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.394808 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.394955 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.395099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.395249 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.395393 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.395393 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.395690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.395855 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.396008 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.396701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.396798 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.396890 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.396977 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.396977 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.397372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.397460 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.397542 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.397630 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.397712 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.397820 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.397894 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.397983 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.398071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.398153 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.398480 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.398575 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.398658 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.398658 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.398805 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-24-iscsi {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.398884 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.398956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.399037 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.399115 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.399285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.399383 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.399603 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.399735 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.399908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.400053 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.400230 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.400365 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.400539 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.400693 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.400856 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.401020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.401165 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.401337 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.401531 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.401710 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.401894 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.402070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.402221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.402378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.402524 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.402677 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.402829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.402983 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.403138 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.403286 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.403429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.403573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.403716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.403870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.404024 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.404176 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.404322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.404476 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.404621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.404764 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.404923 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.405076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.405228 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.405383 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.405536 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.405681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.405977 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.406135 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.406292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.406439 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.406592 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.406746 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.406902 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.407047 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.407235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.407387 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.407535 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.407703 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.407856 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.408002 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.408146 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.408297 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.408455 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.408602 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.408753 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.408906 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.409058 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.409272 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.409429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.409577 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.409760 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.409925 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.410081 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.410233 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.410402 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.410557 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.410715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.410869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.411014 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.411168 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.411323 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.411468 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.411613 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.411779 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.411926 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.412080 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.412232 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.412378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.412521 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.412666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.412818 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.412972 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.413126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.413271 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.413423 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.413575 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.413762 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.413935 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.414082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.414235 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.414380 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.414524 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.414675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.414830 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.414974 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.415135 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.415296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.415296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.415578 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.415745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.415893 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.415893 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.416172 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.416316 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.416472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.416472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.416755 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.416908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.417060 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.417253 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.417417 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.417581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.417743 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.417896 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.418055 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.418200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.418353 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.418498 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.418649 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.418795 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.418939 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.419093 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.419255 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.419400 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.419555 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.419706 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.419859 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.420018 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.420164 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.420307 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.420451 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.420595 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.420738 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.420895 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.421048 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.421193 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.421338 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.422046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.422157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.422272 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.422368 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.422459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.422459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.422639 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.422852 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.422993 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.423153 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.423261 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.423460 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.423577 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.423775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.423867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.424154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.424356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.424474 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.424690 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.424797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.425005 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.425104 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.425321 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.425420 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.425666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.425804 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.426012 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.426169 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.426323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.426515 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.426706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.426862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.427033 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.427181 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.427332 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.427506 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.427652 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.427862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.427862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.428155 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.428306 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.428459 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.428608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.428765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.428908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.429057 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.429199 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.429341 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.429484 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.429639 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.429892 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.429996 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.430090 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.430176 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.430266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.430361 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.430447 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.430569 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.430754 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.431105 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.431285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.431445 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.431595 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.431748 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.432097 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.432258 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.432612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.432794 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.432951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.433116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:45.433270 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.433424 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.433580 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.433580 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.433927 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.434076 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.434246 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.434400 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.434561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.434709 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.434861 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.435015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.435169 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.435329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.435604 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.435765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.435911 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.436501 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.436659 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.436911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.437743 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.437913 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.438062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.438216 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.438362 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.438516 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.438663 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.438815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.438961 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.439105 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.439265 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.439418 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.439418 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.439795 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.440002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.440513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.440689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.440846 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.441005 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.441163 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.441387 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.441541 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.441701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.442230 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.442477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.443130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.443309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.443495 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.443818 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.443977 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.444125 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.444707 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.444949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.445114 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.445271 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.445426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.445580 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.445580 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.445945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.446107 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.446255 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.446407 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.446552 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.446705 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.446858 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.447012 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.447165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.447319 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.447465 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.447610 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.447764 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.447919 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.448065 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.448208 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.448361 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.448506 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.448659 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.448812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.448965 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.449121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.449267 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.449413 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.449572 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.449745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.449900 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.450086 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.450237 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.450394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.450551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.450704 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.450704 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.451022 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.451168 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.451321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.451477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.451635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.451779 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.451935 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.452088 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.452244 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.452396 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.452544 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.453220 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.453381 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.453527 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.453688 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.453901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.454048 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.454203 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.454349 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.454492 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.454650 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.454809 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.454955 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.455107 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.455253 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.455396 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.455552 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.455698 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.455843 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.455994 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.456157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.456303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.456461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.456613 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.456766 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.456918 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.457071 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.457225 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.457370 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.457523 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.457668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.457837 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.457984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.458150 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.458295 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.458446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.458591 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.458991 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.459144 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.459298 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.459449 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.459602 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.459749 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.459749 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.460022 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.460217 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.460386 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.460554 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.460554 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.460886 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.461043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.461043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.461327 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.461486 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.461486 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.461779 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.461947 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.461947 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.462244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.462390 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.462390 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.462680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.462835 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.462835 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.463109 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.463264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.463264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.463551 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.463697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.463849 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.464009 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.464009 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.464307 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.464466 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.464466 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.464740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.464892 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.464892 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.465175 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.465329 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.465481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.465634 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.465634 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.466175 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.466344 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.466344 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.467256 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.467422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.467422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.467697 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.467912 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.468068 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.468215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.468215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.469060 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.469215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.469215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.469539 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.469692 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.469869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.470036 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.470243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.470414 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.470569 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.470728 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.470891 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.471052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.471212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.471377 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.471549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.471703 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.471854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.472005 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.472170 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.472330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.472491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.472644 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.472795 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.472946 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.473105 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.473270 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.473437 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.473615 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.473785 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.474108 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.474303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.474462 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.474736 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.474907 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.475061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.475222 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.475222 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.475520 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.475681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.475841 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.476005 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.476230 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.476396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.476556 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.476718 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.476871 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.476871 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.477181 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.477342 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.477502 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.477655 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.477861 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.478018 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.478191 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.478191 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.478486 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.478647 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.478800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.478952 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.479114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.479275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.479435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.479588 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.479738 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.479897 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.480069 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.480230 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.480435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.480603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.480763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.480928 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.481081 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.481233 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.481383 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.481535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.481701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.481903 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.482066 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.482238 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.482399 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.482551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.482702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.482872 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.483027 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.483187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.483352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.483506 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.483658 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.483824 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.484016 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.484173 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.484344 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.484505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.484667 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.484820 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.484971 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.485132 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.485284 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.485442 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.485609 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.485821 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.485982 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.486144 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.486305 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.486468 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.486634 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.486789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.486940 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.487101 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.487255 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.487407 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.487571 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.487733 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.487893 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.488045 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.488197 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.488357 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.488525 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.488680 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.488840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.488993 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.489144 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.489305 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.489457 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.489617 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.489617 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.489951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.490105 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.490271 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.490488 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.490649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.490811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.490963 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.491115 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.491275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.491275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.491573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.491724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.492233 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.492408 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.492563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.492716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.492880 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.493033 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.493220 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.493570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.493836 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.494013 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.494167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.494327 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.494614 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.494800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.494955 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.495106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.495941 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.496063 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.496149 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.496244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.496337 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.496422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.496505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.496579 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.496661 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.496783 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.496947 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.497108 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.497221 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.497295 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.497382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.497459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.497530 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.497609 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.497682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.497816 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.497949 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498042 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498126 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498353 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498434 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498507 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498587 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498667 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498741 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498819 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498900 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.498974 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.499052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.499126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.499126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.499264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.499338 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.499416 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.499490 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.499687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.499687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.499687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.502163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.502339 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.502506 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.502661 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.502814 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.502982 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.503143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.503315 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.503477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.503631 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.503791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.503954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.504118 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.504278 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.504445 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.504606 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.504606 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.504903 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.505055 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.505206 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.505442 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.505604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.505604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.505960 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.506120 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.506291 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.506452 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.506604 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.506755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.506907 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.507060 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.507220 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.507384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.507556 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.507716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.507869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.508019 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.508186 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.508338 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.509175 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.509354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.509510 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.509670 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.509868 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.510024 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.510178 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.510340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.510500 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.510662 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.510815 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.510966 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.511169 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.511336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.511490 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.511652 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.511813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.511974 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.512135 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.512309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.512472 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.512634 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.512796 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.512958 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.513118 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.513272 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.513436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.513598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.513770 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.513941 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.514106 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.514266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.514440 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.514603 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.514757 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.514915 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.515068 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.515068 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.516069 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.516250 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.516406 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.516560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.516711 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.516864 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.517025 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.517189 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.517348 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.517510 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.517671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.517671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.518042 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.518203 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.518356 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.518516 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.518671 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.518836 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.518997 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.519151 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.519314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.519481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.519637 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.519798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.519951 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.520110 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.520270 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.520423 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.520583 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.520745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.520899 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.520899 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.521278 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.521457 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.521620 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.521795 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.521965 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.522119 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.522271 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.522436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.522597 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.522750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.522903 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.523056 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.523228 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.523389 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.523549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.523702 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.523863 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.524027 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.524190 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.524352 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.524512 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.524666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.524827 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.524989 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.525152 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.525324 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.525692 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.525892 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.526050 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.526212 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.526373 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.526535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.526697 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.526857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.527018 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.527186 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.527346 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.527510 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.527670 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.527824 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.527983 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.528151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.528304 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.528464 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.528616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.528768 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.528999 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.529165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.529165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.529455 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.529626 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.529850 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.530026 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.530181 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.530342 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.530505 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.530658 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.530863 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.531566 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.531727 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.531887 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.532041 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.532201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.532368 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.532541 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.532695 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.532846 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.532997 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.533148 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.533309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.533481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.533646 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.533646 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.533981 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.534146 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.534327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.534487 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.534640 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.534792 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.534944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.535096 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.535256 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.535256 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.535554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.535715 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.535875 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.536029 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.536195 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.536369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.536531 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.536683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.536836 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.536995 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.537170 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.537324 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.537477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.537629 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.537869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.538045 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.538255 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.538412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.538586 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.538747 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.538907 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.539070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.539223 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.539383 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.539537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.539689 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.539848 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.540010 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.540163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.540314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.540465 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.540629 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.540781 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.540946 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.541107 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.541260 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.541411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.541608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.541809 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.541976 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.542138 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.542290 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.542441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.542604 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.542772 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.542933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.543094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.543254 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.543414 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.543567 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.543727 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.543881 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.544052 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.544214 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.544374 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.544526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.544702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.544702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.545008 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.545008 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.545297 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.545462 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.545614 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.545784 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.545944 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.546096 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.546247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.546435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.546604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.546769 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.546922 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.546922 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.547226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.547389 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.547549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.547702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.547854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.548019 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.548174 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.548335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.548503 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.548656 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.548820 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.548973 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.549134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.549296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.549495 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.549649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.549866 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.550025 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.550192 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.550192 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.550496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.550657 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.550865 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.551025 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.551188 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.551342 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.551494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.551690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.551858 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.552013 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.552179 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.552340 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.552494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.552693 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.552866 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.553104 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.553274 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.553429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.553589 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.553760 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.553920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.554099 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.554254 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.554414 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.554574 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.554574 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.554881 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.555046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.555211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.555371 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.555524 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.555676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.555836 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.555990 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.556142 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.556304 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.556466 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.556618 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.556778 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.556931 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.556931 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.557236 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.557391 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.557552 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.557717 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.557959 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.558110 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.558263 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.558414 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.558578 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.558740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.558893 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.559045 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.559214 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.559374 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.559605 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.559769 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.559939 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.560091 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.560243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.560395 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.560555 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.560709 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.560860 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.561011 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.561172 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.561323 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.561485 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.561638 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.561855 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.562050 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.562696 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.562864 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.563026 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.563179 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.563332 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.563493 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.563647 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.563825 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.564034 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.564200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.564361 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.564514 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.564666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.564829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.564990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.565150 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.565303 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.565463 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.565625 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.565820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.565980 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.566141 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.566302 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.566462 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.566625 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.566777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.566930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.567082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.567243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.567395 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.567556 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.567717 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.567889 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.568043 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.568209 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.568361 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.568523 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.568677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.568836 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.568997 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.569158 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.569319 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.569481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.569642 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.569861 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.570032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.570032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.570346 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.570499 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.570651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.570810 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.570970 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.571131 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.571293 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.571446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.571598 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.571749 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.571953 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.572121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.572283 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.572436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.572604 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.572761 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.572921 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.573082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.573236 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.573388 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.573549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.573709 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.573886 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.574075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.574075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.574375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.574535 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.574696 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.574849 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.575014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.575176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.575331 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.575483 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.575642 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.575801 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.575968 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.576135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.576289 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.576449 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.576618 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.576784 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.576945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.577098 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.577250 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.577412 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.577573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.577858 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.578031 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.578031 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.578870 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.579033 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.579193 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.579357 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.579511 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.579663 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.579823 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.579977 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.580136 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.580136 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.580451 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.580604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.580768 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.580921 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.581082 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.581243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.581397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.581397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.581686 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.581686 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.582063 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.582248 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.582403 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.582564 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.582718 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.582888 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.583056 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.583210 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.583363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.583522 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.583677 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.584094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.584249 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.584410 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.584564 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.584717 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.584877 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.585050 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.585219 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.585379 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.585533 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.585694 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.585900 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.586070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.586224 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.586376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.586537 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.586710 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.586864 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.587028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.587193 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.587346 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.587346 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.587643 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.587806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.587959 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.588120 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.588274 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.588426 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.588579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.588740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.588904 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.589078 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.589232 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.589383 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.589543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.589710 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.589899 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.590055 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.590216 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.590369 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.590598 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.590753 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.590906 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.591068 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.591239 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.591393 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.591556 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.591717 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.591870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.592114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:51:45.592283 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.592283 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.592283 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.592283 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.592283 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.592283 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.592283 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.593350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.593350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.593350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.593350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.593350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.593350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.593350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.593350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.594589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.594589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.594589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.594589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.594589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.594589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.594589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.594589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.595746 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.595746 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.595746 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.595746 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.595746 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.595746 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.595746 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.595746 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.596945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.596945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.596945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.596945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.596945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.596945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.596945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.596945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.598121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.598121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.598121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.598121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.598121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.598121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.598121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.598121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.599307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.599307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.599307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.599307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.599307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.599307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.599307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.599307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.600454 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.600454 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.600454 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.600454 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.600454 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.601182 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.601182 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.601478 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.601628 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.601933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.602242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.602560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.602869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.603177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.603486 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.603796 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.604115 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.604424 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.604845 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.605156 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.605472 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.605862 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.606181 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.606491 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.606816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.607127 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.607435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.607760 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.608075 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.608403 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.608721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.609070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.609427 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.609796 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.610330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.610672 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.610998 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.611338 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.611675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.611990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.612298 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.612608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.612937 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.613253 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.613570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.613908 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.614224 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.614538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.614851 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.615165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.615478 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.615789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.616150 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.616415 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.616727 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.617038 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.617352 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.617672 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.618239 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.618419 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.618663 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.618990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.619314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.619633 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.619958 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.620258 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.620572 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.620893 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.621229 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.621548 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.621956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.622397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.622717 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.623041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.623365 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.623677 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.624005 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.624333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.625170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.625513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.626116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.626761 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.627326 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.627946 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.628420 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.628753 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.629084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.629400 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.630006 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.630397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.630748 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.631133 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.631530 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.632103 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.632659 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.633181 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.633786 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.634085 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.634352 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.634563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.634774 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.635483 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.635483 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.635842 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.635996 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.636301 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.636612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.636927 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.637233 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.637545 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.637881 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.638205 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.638544 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.638874 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.639206 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.639526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.639855 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.640304 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.640624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.640862 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.641185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.641501 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.641866 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.642188 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.642927 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.642927 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.643233 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.643629 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.643795 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.644044 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.644423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.644850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.645237 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.645557 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO dbcounter [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Registered counter for database nova_api Sep 08 13:51:45.645932 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.646345 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.646798 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.647326 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.647674 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.648070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.648368 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.648686 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.649167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.649607 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.650032 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.650459 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.650731 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.651048 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.651422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.651736 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.652071 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.652483 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.652724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.653059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.653442 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.653793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.654543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.654757 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.655082 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.655402 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.655714 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:45.656484 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:51:45.667665 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_db.sqlalchemy.engines [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:45.674975 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writer thread running {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:45.720285 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO dbcounter [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Registered counter for database nova_api Sep 08 13:51:45.733827 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.context [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),55c333e2-b047-4e60-8a00-16984688bbb6(cell1) {{(pid=126919) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 13:51:45.738414 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:45.738880 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:45.740447 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:45.741076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_db.sqlalchemy.engines [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:45.741187 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:45.741621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:45.743787 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:45.745815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO dbcounter [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Registered counter for database nova_cell0 Sep 08 13:51:45.747675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writer thread running {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:45.750332 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO dbcounter [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Registered counter for database nova_cell1 Sep 08 13:51:45.757653 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_db.sqlalchemy.engines [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:45.759564 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_db.sqlalchemy.engines [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:45.764989 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writer thread running {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:45.767624 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writer thread running {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:45.805327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.context [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),55c333e2-b047-4e60-8a00-16984688bbb6(cell1) {{(pid=126920) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 13:51:45.809410 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:45.810070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:45.811662 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:45.812449 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:45.812901 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:45.815199 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:45.817267 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO dbcounter [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Registered counter for database nova_cell0 Sep 08 13:51:45.821343 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO dbcounter [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Registered counter for database nova_cell1 Sep 08 13:51:45.829501 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_db.sqlalchemy.engines [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:45.831526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_db.sqlalchemy.engines [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:45.839768 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writer thread running {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:45.840106 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writer thread running {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:45.914526 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO dbcounter [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Registered counter for database nova_cell0 Sep 08 13:51:45.922415 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_db.sqlalchemy.engines [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:45.926873 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writer thread running {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:45.992899 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO dbcounter [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Registered counter for database nova_cell0 Sep 08 13:51:45.999466 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_db.sqlalchemy.engines [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:46.003949 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writer thread running {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:46.243355 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: WARNING keystonemiddleware.auth_token [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:51:46.251147 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: WARNING keystonemiddleware.auth_token [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:51:46.326134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: WARNING keystonemiddleware.auth_token [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:51:46.333585 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: WARNING keystonemiddleware.auth_token [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:51:46.597105 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: WARNING keystonemiddleware.auth_token [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:51:46.603440 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: WARNING keystonemiddleware.auth_token [None req-fd6fca08-771a-4cba-b4b4-bd37341e29e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:51:46.608850 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f1e08fc9c0 pid: 126919 (default app) Sep 08 13:51:46.691061 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: WARNING keystonemiddleware.auth_token [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:51:46.697278 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: WARNING keystonemiddleware.auth_token [None req-fda58045-58c9-4af4-9ad0-7a3c2bfcf928 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:51:46.703246 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f1e08fc9c0 pid: 126920 (default app) Sep 08 13:52:21.473076 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:21.473969 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:21.474714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:21.475458 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:22.519342 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9aa8b2f0-f71b-42a6-9a7e-bcb256384224 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Action: 'create', calling method: .version_select at 0x7f5be54873a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1912192530"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:23.164432 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:23.165376 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:23.166612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:23.168768 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:24.384285 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-23ece6e0-1f11-4a36-9f41-ef519a8b3a31 tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] Action: 'create', calling method: .version_select at 0x7f5be54873a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-228898665", "metadata": {"Type": "work"}}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:24.789408 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9aa8b2f0-f71b-42a6-9a7e-bcb256384224 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.323381 Sep 08 13:52:24.790831 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1155 bytes} [Thu Sep 8 13:52:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3326 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 13:52:24.809125 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-114325f7-c0e3-41e1-844f-34348fbc8958 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be5368280>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:25.031852 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-114325f7-c0e3-41e1-844f-34348fbc8958 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad" status: 200 len: 345 microversion: 2.1 time: 0.227036 Sep 08 13:52:25.032808 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 2/2] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:24 2022] GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad => generated 345 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:25.529493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-23ece6e0-1f11-4a36-9f41-ef519a8b3a31 tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.371286 Sep 08 13:52:25.542107 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 1/3] 10.222.0.55 () {60 vars in 1156 bytes} [Thu Sep 8 13:52:23 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2376 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 13:52:25.547184 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1d2abadb-ba2b-49a8-99bf-5ec88f1b3d9c tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] Calling method '.version_select at 0x7f5be5368940>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:25.659882 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1d2abadb-ba2b-49a8-99bf-5ec88f1b3d9c tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0" status: 200 len: 352 microversion: 2.1 time: 0.116430 Sep 08 13:52:25.665793 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 3/4] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:25 2022] GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:26.048411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a86e815d-c86e-485b-9385-cbe23216f922 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be5369280>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:26.201862 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a86e815d-c86e-485b-9385-cbe23216f922 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad" status: 200 len: 346 microversion: 2.1 time: 0.159324 Sep 08 13:52:26.203438 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 2/5] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:26 2022] GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad => generated 346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:52:26.216543 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8357a6f8-c44c-4c94-9402-33b2973f760b tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Action: 'create', calling method: .version_select at 0x7f5be52ed040>, body: {"snapshot": {"volume_id": "5462f4b5-7e01-48a8-a687-8928616144ad", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1576420317"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:26.679956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3bec2c0e-18b8-4a51-85b1-afa04585b615 tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] Calling method '.version_select at 0x7f5be53699d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:26.741016 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8357a6f8-c44c-4c94-9402-33b2973f760b tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.528329 Sep 08 13:52:26.741589 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 4/6] 10.222.0.55 () {60 vars in 1162 bytes} [Thu Sep 8 13:52:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:26.752488 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dc345159-29c5-4a81-96c5-4826a2d8b0b2 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be52ed8b0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:26.834749 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dc345159-29c5-4a81-96c5-4826a2d8b0b2 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a" status: 200 len: 287 microversion: 2.1 time: 0.085816 Sep 08 13:52:26.835916 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 5/7] 10.222.0.55 () {58 vars in 1251 bytes} [Thu Sep 8 13:52:26 2022] GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:52:26.868062 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1bc39c04-cc7a-4eb4-8b03-0b10d1ca1e43 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be52ed1f0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:26.981055 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1bc39c04-cc7a-4eb4-8b03-0b10d1ca1e43 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.137640 Sep 08 13:52:26.982243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 6/8] 10.222.0.55 () {58 vars in 1140 bytes} [Thu Sep 8 13:52:26 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:26.995592 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ccc4e911-5f55-4532-b5d9-cb8d3f1c0f0e tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be5368d30>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:27.032847 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3bec2c0e-18b8-4a51-85b1-afa04585b615 tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0" status: 200 len: 353 microversion: 2.1 time: 0.359958 Sep 08 13:52:27.041909 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 3/9] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:26 2022] GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0 => generated 353 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:27.047876 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-11b7461a-6120-4844-8124-aa5d27a50b7f tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] Calling method '.version_select at 0x7f5be52ee0d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:27.112033 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ccc4e911-5f55-4532-b5d9-cb8d3f1c0f0e tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a" status: 200 len: 287 microversion: 2.1 time: 0.121933 Sep 08 13:52:27.112842 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 7/10] 10.222.0.55 () {58 vars in 1251 bytes} [Thu Sep 8 13:52:26 2022] GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:52:27.118078 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-11b7461a-6120-4844-8124-aa5d27a50b7f tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0" status: 200 len: 353 microversion: 2.1 time: 0.074743 Sep 08 13:52:27.119046 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 4/11] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:27 2022] GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:27.134623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e745222e-93b8-4c5f-983d-967c6c2452ee tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] Calling method '.version_select at 0x7f5be5368700>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:27.342006 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e745222e-93b8-4c5f-983d-967c6c2452ee tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0" status: 202 len: 0 microversion: 2.1 time: 0.212053 Sep 08 13:52:27.345402 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 8/12] 10.222.0.55 () {58 vars in 1248 bytes} [Thu Sep 8 13:52:27 2022] DELETE /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:52:27.355310 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ebf7656f-2264-4570-9817-add8282c9b96 tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] Calling method '.version_select at 0x7f5be5369d30>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:27.441062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ebf7656f-2264-4570-9817-add8282c9b96 tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0" status: 200 len: 352 microversion: 2.1 time: 0.091358 Sep 08 13:52:27.441965 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 5/13] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:27 2022] GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:28.126199 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ffad90f-d25e-4936-ab7b-dde176db953b tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be5368040>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:28.194840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ffad90f-d25e-4936-ab7b-dde176db953b tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a" status: 200 len: 287 microversion: 2.1 time: 0.073864 Sep 08 13:52:28.195427 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 9/14] 10.222.0.55 () {58 vars in 1251 bytes} [Thu Sep 8 13:52:28 2022] GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:28.455707 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-594540c5-4a56-4993-bd34-ba795333c14c tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] Calling method '.version_select at 0x7f5be53695e0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:28.512367 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-594540c5-4a56-4993-bd34-ba795333c14c tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0" status: 200 len: 352 microversion: 2.1 time: 0.060302 Sep 08 13:52:28.519812 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 6/15] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:28 2022] GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:29.209097 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c7f4c719-f53d-4c43-82bc-a22786b83ebb tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be52edd30>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:29.294071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c7f4c719-f53d-4c43-82bc-a22786b83ebb tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a" status: 200 len: 287 microversion: 2.1 time: 0.088913 Sep 08 13:52:29.294834 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 10/16] 10.222.0.55 () {58 vars in 1251 bytes} [Thu Sep 8 13:52:29 2022] GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:29.552890 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f0cbae4-26ea-4cb0-83d1-8321fd03370f tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] Calling method '.version_select at 0x7f5be52ee3a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:29.645027 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f0cbae4-26ea-4cb0-83d1-8321fd03370f tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0" status: 200 len: 352 microversion: 2.1 time: 0.121341 Sep 08 13:52:29.653882 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 7/17] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:29 2022] GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0 => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:30.310934 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3518dad4-724a-4808-8edb-ed3b0d3d24da tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be5368af0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:30.387406 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3518dad4-724a-4808-8edb-ed3b0d3d24da tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a" status: 200 len: 288 microversion: 2.1 time: 0.083525 Sep 08 13:52:30.387976 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 11/18] 10.222.0.55 () {58 vars in 1251 bytes} [Thu Sep 8 13:52:30 2022] GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a => generated 288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:30.400784 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca80fbbf-8da6-4d81-962f-15ab3f776c7f tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be53693a0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:30.576137 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca80fbbf-8da6-4d81-962f-15ab3f776c7f tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a" status: 202 len: 0 microversion: 2.1 time: 0.179270 Sep 08 13:52:30.576646 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 8/19] 10.222.0.55 () {58 vars in 1254 bytes} [Thu Sep 8 13:52:30 2022] DELETE /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:52:30.585885 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b5fa5524-0296-4e50-a715-54bb8a6c8b52 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be53685e0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:30.660829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40948174-097e-46fa-8285-dc30e237fe14 tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] Calling method '.version_select at 0x7f5be5369b80>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:30.663822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b5fa5524-0296-4e50-a715-54bb8a6c8b52 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a" status: 200 len: 287 microversion: 2.1 time: 0.082217 Sep 08 13:52:30.664391 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 12/20] 10.222.0.55 () {58 vars in 1251 bytes} [Thu Sep 8 13:52:30 2022] GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:52:30.741285 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-40948174-097e-46fa-8285-dc30e237fe14 tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] HTTP exception thrown: Volume c2bb5c02-f5ce-45a3-9627-fc965a7160c0 could not be found. Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40948174-097e-46fa-8285-dc30e237fe14 tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] Request method failure captured: Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0 HTTP/1.1 Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOXRfC2-qFEsX12Q2rpi8Wj5dkL1L_xrI8PqNROt6MErSR0_JMeY5dhIaWkf1Vg66wy2VyXnCCkKo0RLvEN_QrbFbODauXtE3oqcgipSyQphGDGfK3FVTudmcNgCyiGmg1bdtPNNL1MOL04We1_7Ew5CmlU6oR8JsJxojK3WFZC84c Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: b2b7fd2f4a4e478bb57d996da77bb2cd Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesGetTestJSON-277969639 Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:52:30.745668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b2b7fd2f4a4e478bb57d996da77bb2cd", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b2b7fd2f4a4e478bb57d996da77bb2cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2b7fd2f4a4e478bb57d996da77bb2cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2b7fd2f4a4e478bb57d996da77bb2cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-VolumesGetTestJSON-277969639 Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: b2b7fd2f4a4e478bb57d996da77bb2cd Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesGetTestJSON-277969639 Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-VolumesGetTestJSON-277969639-project Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: b7cd12278c4c456f8e33bc43d6578cb6 Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-VolumesGetTestJSON-277969639-project Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Volume c2bb5c02-f5ce-45a3-9627-fc965a7160c0 could not be found. Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': 'c2bb5c02-f5ce-45a3-9627-fc965a7160c0'} Sep 08 13:52:30.747146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2bb5c02-f5ce-45a3-9627-fc965a7160c0 could not be found. (HTTP 404) (Request-ID: req-21c8cadd-9910-4f7b-acf2-792beb0f6b17) Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:30.747966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:52:30.749067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2bb5c02-f5ce-45a3-9627-fc965a7160c0 could not be found. Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 13:52:30.751395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2bb5c02-f5ce-45a3-9627-fc965a7160c0 could not be found. Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2bb5c02-f5ce-45a3-9627-fc965a7160c0 could not be found. Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40948174-097e-46fa-8285-dc30e237fe14 tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] Returning 404 to user: Volume c2bb5c02-f5ce-45a3-9627-fc965a7160c0 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40948174-097e-46fa-8285-dc30e237fe14 tempest-VolumesGetTestJSON-277969639 tempest-VolumesGetTestJSON-277969639-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0" status: 404 len: 109 microversion: 2.1 time: 0.090672 Sep 08 13:52:30.753312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 9/21] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:30 2022] GET /compute/v2.1/os-volumes/c2bb5c02-f5ce-45a3-9627-fc965a7160c0 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:52:31.677994 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d55145f5-f7df-4486-8245-a63d0f6bd924 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be52ed280>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:31.716181 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-d55145f5-f7df-4486-8245-a63d0f6bd924 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] HTTP exception thrown: Snapshot 3be4fd60-378c-4757-bd8f-cea80efe723a could not be found. Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d55145f5-f7df-4486-8245-a63d0f6bd924 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Request method failure captured: Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a HTTP/1.1 Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOVtdcHExEH5EbofvzCwgY39CZXsejeH2xb1hacRZmuy4-Y4d0L-ZrLleu42HoEnVxIkvTSRVAnb3eKRHDd4COrfkINyp6oz5ajF9dQBlTcHhp7FCLamYGK20WsJRwgtMgY5G2nn2GEsnGuw0LOR0qw1Q8tu4HQRtWz0q6XkbxFRYc Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 8a4eb5c1f5b44cfab4a3869cc0a06851 Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:52:31.722748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8a4eb5c1f5b44cfab4a3869cc0a06851", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 8a4eb5c1f5b44cfab4a3869cc0a06851 Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-VolumesSnapshotsTestJSON-223122548-project Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: cbea503b4cca4fb886179ff3e0564301 Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-223122548-project Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Snapshot 3be4fd60-378c-4757-bd8f-cea80efe723a could not be found. Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '3be4fd60-378c-4757-bd8f-cea80efe723a'} Sep 08 13:52:31.724159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3be4fd60-378c-4757-bd8f-cea80efe723a could not be found. (HTTP 404) (Request-ID: req-28b55730-fb75-46de-9689-613b880136bc) Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:31.725082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:52:31.726189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3be4fd60-378c-4757-bd8f-cea80efe723a could not be found. Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 08 13:52:31.727288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:52:31.728441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3be4fd60-378c-4757-bd8f-cea80efe723a could not be found. Sep 08 13:52:31.728441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:31.728441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:31.728441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:31.728441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:31.728441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:31.728441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:31.728441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:52:31.728441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:52:31.728441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3be4fd60-378c-4757-bd8f-cea80efe723a could not be found. Sep 08 13:52:31.728441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:31.731373 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d55145f5-f7df-4486-8245-a63d0f6bd924 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Returning 404 to user: Snapshot 3be4fd60-378c-4757-bd8f-cea80efe723a could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:31.732242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d55145f5-f7df-4486-8245-a63d0f6bd924 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a" status: 404 len: 111 microversion: 2.1 time: 0.058876 Sep 08 13:52:31.738502 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 13/22] 10.222.0.55 () {58 vars in 1251 bytes} [Thu Sep 8 13:52:31 2022] GET /compute/v2.1/os-snapshots/3be4fd60-378c-4757-bd8f-cea80efe723a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:52:31.746744 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-071da544-1ae9-4723-a23b-8692e710c6cf tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be52eeaf0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:31.877259 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-071da544-1ae9-4723-a23b-8692e710c6cf tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad" status: 202 len: 0 microversion: 2.1 time: 0.132947 Sep 08 13:52:31.883258 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 10/23] 10.222.0.55 () {58 vars in 1248 bytes} [Thu Sep 8 13:52:31 2022] DELETE /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:52:31.891644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-72f4e995-9dbf-4e2d-8f11-4ce4625eed89 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be52edc10>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:32.034838 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-72f4e995-9dbf-4e2d-8f11-4ce4625eed89 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad" status: 200 len: 345 microversion: 2.1 time: 0.147365 Sep 08 13:52:32.036343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 14/24] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:31 2022] GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:33.051167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57efa37f-1a48-4d5f-a957-4a4fd819f3ba tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be52da1f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:33.106986 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-57efa37f-1a48-4d5f-a957-4a4fd819f3ba tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] HTTP exception thrown: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57efa37f-1a48-4d5f-a957-4a4fd819f3ba tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Request method failure captured: Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad HTTP/1.1 Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOVtdcHExEH5EbofvzCwgY39CZXsejeH2xb1hacRZmuy4-Y4d0L-ZrLleu42HoEnVxIkvTSRVAnb3eKRHDd4COrfkINyp6oz5ajF9dQBlTcHhp7FCLamYGK20WsJRwgtMgY5G2nn2GEsnGuw0LOR0qw1Q8tu4HQRtWz0q6XkbxFRYc Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 8a4eb5c1f5b44cfab4a3869cc0a06851 Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:52:33.110185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8a4eb5c1f5b44cfab4a3869cc0a06851", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 8a4eb5c1f5b44cfab4a3869cc0a06851 Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-VolumesSnapshotsTestJSON-223122548-project Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: cbea503b4cca4fb886179ff3e0564301 Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-223122548-project Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '5462f4b5-7e01-48a8-a687-8928616144ad'} Sep 08 13:52:33.111333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. (HTTP 404) (Request-ID: req-6b0318f4-bbab-4948-9a6e-b724ead74d1b) Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:33.111973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:52:33.112929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 13:52:33.113850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:52:33.114745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.114745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.114745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:33.114745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.114745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.114745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:33.114745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:33.114745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:52:33.114745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:52:33.114745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.114745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.118391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57efa37f-1a48-4d5f-a957-4a4fd819f3ba tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Returning 404 to user: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:33.119487 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-57efa37f-1a48-4d5f-a957-4a4fd819f3ba tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad" status: 404 len: 109 microversion: 2.1 time: 0.072194 Sep 08 13:52:33.120540 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 11/25] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:33 2022] GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:52:33.135353 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd0dc8e3-c88c-4cf2-8295-aa6e3e94ac12 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be52dd3a0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:33.219511 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-bd0dc8e3-c88c-4cf2-8295-aa6e3e94ac12 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] HTTP exception thrown: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd0dc8e3-c88c-4cf2-8295-aa6e3e94ac12 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Request method failure captured: Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad HTTP/1.1 Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOVtdcHExEH5EbofvzCwgY39CZXsejeH2xb1hacRZmuy4-Y4d0L-ZrLleu42HoEnVxIkvTSRVAnb3eKRHDd4COrfkINyp6oz5ajF9dQBlTcHhp7FCLamYGK20WsJRwgtMgY5G2nn2GEsnGuw0LOR0qw1Q8tu4HQRtWz0q6XkbxFRYc Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 8a4eb5c1f5b44cfab4a3869cc0a06851 Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:52:33.222777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8a4eb5c1f5b44cfab4a3869cc0a06851", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 8a4eb5c1f5b44cfab4a3869cc0a06851 Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-VolumesSnapshotsTestJSON-223122548-project Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: cbea503b4cca4fb886179ff3e0564301 Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-223122548-project Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '5462f4b5-7e01-48a8-a687-8928616144ad'} Sep 08 13:52:33.224112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. (HTTP 404) (Request-ID: req-b59458b1-7ce5-4d44-8ebb-e198ea85da31) Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:33.224911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 13:52:33.226343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 13:52:33.227472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:52:33.228537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.228537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.228537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:33.228537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.228537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.228537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:33.228537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:33.228537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:52:33.228537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:52:33.228537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.228537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.231508 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bd0dc8e3-c88c-4cf2-8295-aa6e3e94ac12 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Returning 404 to user: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:33.233006 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bd0dc8e3-c88c-4cf2-8295-aa6e3e94ac12 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad" status: 404 len: 109 microversion: 2.1 time: 0.102253 Sep 08 13:52:33.233929 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 15/26] 10.222.0.55 () {58 vars in 1248 bytes} [Thu Sep 8 13:52:33 2022] DELETE /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:52:33.242271 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a4138c5-ccc7-48f3-9ffe-aa00a9a45fb7 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Calling method '.version_select at 0x7f5be52da790>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:33.300823 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-8a4138c5-ccc7-48f3-9ffe-aa00a9a45fb7 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] HTTP exception thrown: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a4138c5-ccc7-48f3-9ffe-aa00a9a45fb7 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Request method failure captured: Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad HTTP/1.1 Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOVtdcHExEH5EbofvzCwgY39CZXsejeH2xb1hacRZmuy4-Y4d0L-ZrLleu42HoEnVxIkvTSRVAnb3eKRHDd4COrfkINyp6oz5ajF9dQBlTcHhp7FCLamYGK20WsJRwgtMgY5G2nn2GEsnGuw0LOR0qw1Q8tu4HQRtWz0q6XkbxFRYc Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 8a4eb5c1f5b44cfab4a3869cc0a06851 Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:52:33.303210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8a4eb5c1f5b44cfab4a3869cc0a06851", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8a4eb5c1f5b44cfab4a3869cc0a06851"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 8a4eb5c1f5b44cfab4a3869cc0a06851 Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-223122548 Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-VolumesSnapshotsTestJSON-223122548-project Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: cbea503b4cca4fb886179ff3e0564301 Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-223122548-project Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '5462f4b5-7e01-48a8-a687-8928616144ad'} Sep 08 13:52:33.304363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. (HTTP 404) (Request-ID: req-92bf8778-ce3b-425d-807a-0eaa625dafba) Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:33.304985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:52:33.306088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 13:52:33.307020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:52:33.307917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.307917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.307917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:33.307917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.307917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:33.307917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:33.307917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:33.307917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:52:33.307917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:52:33.307917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. Sep 08 13:52:33.307917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:33.309996 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a4138c5-ccc7-48f3-9ffe-aa00a9a45fb7 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] Returning 404 to user: Volume 5462f4b5-7e01-48a8-a687-8928616144ad could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:33.311102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8a4138c5-ccc7-48f3-9ffe-aa00a9a45fb7 tempest-VolumesSnapshotsTestJSON-223122548 tempest-VolumesSnapshotsTestJSON-223122548-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad" status: 404 len: 109 microversion: 2.1 time: 0.073105 Sep 08 13:52:33.311878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 12/27] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:33 2022] GET /compute/v2.1/os-volumes/5462f4b5-7e01-48a8-a687-8928616144ad => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:52:35.652647 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa0a190a-2112-475b-90f3-3b0c4bfb6ca0 tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Action: 'create', calling method: .version_select at 0x7f5be52dd670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1988229538", "metadata": {"Type": "work"}}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa0a190a-2112-475b-90f3-3b0c4bfb6ca0 tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Request method failure captured: Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 122 Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOj426htoW8fe5yb4_nG6ldjzV-ccQs6Ib6INk_vpEv9XJ56rtlLOd68MeTPtXRIarBg5O2xfF49gRxPOtM4sewDTBc7BVz1oxqhU2e7WPiDv7JeLz_rCG_2Shj6HSXZi11M_5ohrdRCqX-t8pVvQmllCVPKoXbp4OzTupH_iwIlSQ Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:52:35.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_18e9b0ebe369463780030429234b202b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/18e9b0ebe369463780030429234b202b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 8fa80058381045d6af75036716c834d7 Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1988229538", "metadata": {"Type": "work"}}} Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: Sep 08 13:52:35.663807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1988229538', 'metadata': {'Type': 'work'}}}} Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi '#$%' Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:35.664555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:52:35.665714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:52:35.666724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 13:52:35.666724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.666724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa0a190a-2112-475b-90f3-3b0c4bfb6ca0 tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:35.666724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aa0a190a-2112-475b-90f3-3b0c4bfb6ca0 tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.382476 Sep 08 13:52:35.672167 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 16/28] 10.222.0.55 () {60 vars in 1156 bytes} [Thu Sep 8 13:52:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 393 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:52:35.684224 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-407b01b5-2af9-4899-a54d-0c6d31e71125 tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Action: 'create', calling method: .version_select at 0x7f5be52dadc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-498762117", "metadata": {"Type": "work"}}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-407b01b5-2af9-4899-a54d-0c6d31e71125 tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Request method failure captured: Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 119 Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOj426htoW8fe5yb4_nG6ldjzV-ccQs6Ib6INk_vpEv9XJ56rtlLOd68MeTPtXRIarBg5O2xfF49gRxPOtM4sewDTBc7BVz1oxqhU2e7WPiDv7JeLz_rCG_2Shj6HSXZi11M_5ohrdRCqX-t8pVvQmllCVPKoXbp4OzTupH_iwIlSQ Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:52:35.695870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_18e9b0ebe369463780030429234b202b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/18e9b0ebe369463780030429234b202b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 8fa80058381045d6af75036716c834d7 Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-498762117", "metadata": {"Type": "work"}}} Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: Sep 08 13:52:35.697226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-498762117', 'metadata': {'Type': 'work'}}}} Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi '0' Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:35.698041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:52:35.699275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:52:35.701032 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 13:52:35.701032 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.708311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-407b01b5-2af9-4899-a54d-0c6d31e71125 tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:35.710851 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-407b01b5-2af9-4899-a54d-0c6d31e71125 tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.030044 Sep 08 13:52:35.723796 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c52e25b2-14b1-477d-9b45-f789905b0cbb tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Action: 'create', calling method: .version_select at 0x7f5be52dd670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-598477161", "metadata": {"Type": "work"}}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:35.729719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 13/29] 10.222.0.55 () {60 vars in 1156 bytes} [Thu Sep 8 13:52:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c52e25b2-14b1-477d-9b45-f789905b0cbb tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Request method failure captured: Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 118 Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOj426htoW8fe5yb4_nG6ldjzV-ccQs6Ib6INk_vpEv9XJ56rtlLOd68MeTPtXRIarBg5O2xfF49gRxPOtM4sewDTBc7BVz1oxqhU2e7WPiDv7JeLz_rCG_2Shj6HSXZi11M_5ohrdRCqX-t8pVvQmllCVPKoXbp4OzTupH_iwIlSQ Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:52:35.734623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_18e9b0ebe369463780030429234b202b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/18e9b0ebe369463780030429234b202b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 8fa80058381045d6af75036716c834d7 Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-598477161", "metadata": {"Type": "work"}}} Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: Sep 08 13:52:35.735715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-598477161', 'metadata': {'Type': 'work'}}}} Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi '' Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:35.736376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:52:35.737428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:52:35.738635 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 13:52:35.738635 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.752785 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c52e25b2-14b1-477d-9b45-f789905b0cbb tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:35.755306 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c52e25b2-14b1-477d-9b45-f789905b0cbb tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.036163 Sep 08 13:52:35.767327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-adcc97bd-0a6b-4df8-a904-0be792c740bf tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Calling method '.version_select at 0x7f5be528d670>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:35.774612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 17/30] 10.222.0.55 () {60 vars in 1156 bytes} [Thu Sep 8 13:52:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:52:35.829661 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-adcc97bd-0a6b-4df8-a904-0be792c740bf tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] HTTP exception thrown: Volume tempest-invalid-1135232764 could not be found. Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-adcc97bd-0a6b-4df8-a904-0be792c740bf tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Request method failure captured: Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1135232764 HTTP/1.1 Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOj426htoW8fe5yb4_nG6ldjzV-ccQs6Ib6INk_vpEv9XJ56rtlLOd68MeTPtXRIarBg5O2xfF49gRxPOtM4sewDTBc7BVz1oxqhU2e7WPiDv7JeLz_rCG_2Shj6HSXZi11M_5ohrdRCqX-t8pVvQmllCVPKoXbp4OzTupH_iwIlSQ Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:52:35.831869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_18e9b0ebe369463780030429234b202b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/18e9b0ebe369463780030429234b202b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 8fa80058381045d6af75036716c834d7 Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Volume tempest-invalid-1135232764 could not be found. Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': 'tempest-invalid-1135232764'} Sep 08 13:52:35.832948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1135232764 could not be found. (HTTP 404) (Request-ID: req-82f1028b-0c72-4198-acc9-3557208e8e02) Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.833589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 13:52:35.839624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1135232764 could not be found. Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:52:35.840538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1135232764 could not be found. Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1135232764 could not be found. Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-adcc97bd-0a6b-4df8-a904-0be792c740bf tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Returning 404 to user: Volume tempest-invalid-1135232764 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-adcc97bd-0a6b-4df8-a904-0be792c740bf tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1135232764" status: 404 len: 99 microversion: 2.1 time: 0.069978 Sep 08 13:52:35.841493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 14/31] 10.222.0.55 () {58 vars in 1218 bytes} [Thu Sep 8 13:52:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1135232764 => generated 99 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:52:35.845567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3c0aa303-11ef-4015-a5a1-d2f414412154 tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004546 Sep 08 13:52:35.850183 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 18/32] 10.222.0.55 () {58 vars in 1140 bytes} [Thu Sep 8 13:52:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 13:52:35.856713 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-98cb0819-96c1-43e8-b3d9-b4d14506658b tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005070 Sep 08 13:52:35.857243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 15/33] 10.222.0.55 () {58 vars in 1137 bytes} [Thu Sep 8 13:52:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 13:52:35.870420 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d74472d5-d836-4bfd-8ed1-16e89ab618ac tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Calling method '.version_select at 0x7f5be52ed790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:35.959783 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-d74472d5-d836-4bfd-8ed1-16e89ab618ac tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] HTTP exception thrown: Volume 4eee26bc-a32c-42e0-85e1-4d3e06b837c4 could not be found. Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d74472d5-d836-4bfd-8ed1-16e89ab618ac tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Request method failure captured: Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: DELETE /compute/v2.1/os-volumes/4eee26bc-a32c-42e0-85e1-4d3e06b837c4 HTTP/1.1 Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOj426htoW8fe5yb4_nG6ldjzV-ccQs6Ib6INk_vpEv9XJ56rtlLOd68MeTPtXRIarBg5O2xfF49gRxPOtM4sewDTBc7BVz1oxqhU2e7WPiDv7JeLz_rCG_2Shj6HSXZi11M_5ohrdRCqX-t8pVvQmllCVPKoXbp4OzTupH_iwIlSQ Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:52:35.962148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_18e9b0ebe369463780030429234b202b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/18e9b0ebe369463780030429234b202b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 8fa80058381045d6af75036716c834d7 Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Volume 4eee26bc-a32c-42e0-85e1-4d3e06b837c4 could not be found. Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '4eee26bc-a32c-42e0-85e1-4d3e06b837c4'} Sep 08 13:52:35.963491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4eee26bc-a32c-42e0-85e1-4d3e06b837c4 could not be found. (HTTP 404) (Request-ID: req-2185898d-01c0-4f8d-a9b9-1dfd699db16d) Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.969077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 13:52:35.970242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4eee26bc-a32c-42e0-85e1-4d3e06b837c4 could not be found. Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 13:52:35.971360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4eee26bc-a32c-42e0-85e1-4d3e06b837c4 could not be found. Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4eee26bc-a32c-42e0-85e1-4d3e06b837c4 could not be found. Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d74472d5-d836-4bfd-8ed1-16e89ab618ac tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Returning 404 to user: Volume 4eee26bc-a32c-42e0-85e1-4d3e06b837c4 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d74472d5-d836-4bfd-8ed1-16e89ab618ac tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/4eee26bc-a32c-42e0-85e1-4d3e06b837c4" status: 404 len: 109 microversion: 2.1 time: 0.100507 Sep 08 13:52:35.972475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 19/34] 10.222.0.55 () {58 vars in 1248 bytes} [Thu Sep 8 13:52:35 2022] DELETE /compute/v2.1/os-volumes/4eee26bc-a32c-42e0-85e1-4d3e06b837c4 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:52:35.973948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-51cec82a-93e4-4ac4-a8c1-09f9b6a1b39f tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Calling method '.version_select at 0x7f5be52daca0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:36.035424 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-51cec82a-93e4-4ac4-a8c1-09f9b6a1b39f tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] HTTP exception thrown: Volume 68657646-6798-435e-b2d0-713db9e40bc0 could not be found. Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-51cec82a-93e4-4ac4-a8c1-09f9b6a1b39f tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Request method failure captured: Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/os-volumes/68657646-6798-435e-b2d0-713db9e40bc0 HTTP/1.1 Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOj426htoW8fe5yb4_nG6ldjzV-ccQs6Ib6INk_vpEv9XJ56rtlLOd68MeTPtXRIarBg5O2xfF49gRxPOtM4sewDTBc7BVz1oxqhU2e7WPiDv7JeLz_rCG_2Shj6HSXZi11M_5ohrdRCqX-t8pVvQmllCVPKoXbp4OzTupH_iwIlSQ Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:52:36.038687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_18e9b0ebe369463780030429234b202b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/18e9b0ebe369463780030429234b202b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/18e9b0ebe369463780030429234b202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 18e9b0ebe369463780030429234b202b Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesNegativeTest-2014576335 Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 8fa80058381045d6af75036716c834d7 Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-VolumesNegativeTest-2014576335-project Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Volume 68657646-6798-435e-b2d0-713db9e40bc0 could not be found. Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '68657646-6798-435e-b2d0-713db9e40bc0'} Sep 08 13:52:36.039816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68657646-6798-435e-b2d0-713db9e40bc0 could not be found. (HTTP 404) (Request-ID: req-1a35361b-0ecd-4174-b92a-4565f12dae44) Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:36.040480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:52:36.050963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68657646-6798-435e-b2d0-713db9e40bc0 could not be found. Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 13:52:36.051878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68657646-6798-435e-b2d0-713db9e40bc0 could not be found. Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68657646-6798-435e-b2d0-713db9e40bc0 could not be found. Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-51cec82a-93e4-4ac4-a8c1-09f9b6a1b39f tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] Returning 404 to user: Volume 68657646-6798-435e-b2d0-713db9e40bc0 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-51cec82a-93e4-4ac4-a8c1-09f9b6a1b39f tempest-VolumesNegativeTest-2014576335 tempest-VolumesNegativeTest-2014576335-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/68657646-6798-435e-b2d0-713db9e40bc0" status: 404 len: 109 microversion: 2.1 time: 0.070435 Sep 08 13:52:36.052797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 16/35] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:52:35 2022] GET /compute/v2.1/os-volumes/68657646-6798-435e-b2d0-713db9e40bc0 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:52:37.919433 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-442136985", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "networks": [{"uuid": "1f51bdfd-daa1-4029-afe2-09413a504f9f"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:38.230525 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] validate_networks() for [('1f51bdfd-daa1-4029-afe2-09413a504f9f', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:52:41.204077 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b512d9ac-d55a-4e8e-8c57-089ba9849b3a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: .version_select at 0x7f5be5292430>, body: {"keypair": {"name": "tempest-keypair-1559639221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMM1xar8d2Jrjj1PsDgQhx6tCzsX5wc9Zb/d8+aqCcoxvJioJjy7kKd8jkkB0TWvcyWveakymhFbQpc9lAABlYG3zeSSLHNRO/SuUo4l8W9hungRZGlYywHYjVQireyFA=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:41.302719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-b512d9ac-d55a-4e8e-8c57-089ba9849b3a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for project b4ca185497284e9780eba8fc2e713d6e. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:52:41.310093 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-b512d9ac-d55a-4e8e-8c57-089ba9849b3a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for user 2e48a8c1b91142cf9d1af17f28e41961 and project b4ca185497284e9780eba8fc2e713d6e. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:52:41.387673 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b512d9ac-d55a-4e8e-8c57-089ba9849b3a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.709421 Sep 08 13:52:41.388919 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 17/36] 10.222.0.55 () {60 vars in 1159 bytes} [Thu Sep 8 13:52:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:42.560741 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:52:42.561292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:52:42.562320 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:52:42.562985 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:52:42.563470 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:52:42.618276 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:42.622147 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:42.627814 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:42.631951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:42.640526 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:42.642692 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:42.768995 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Getting quotas for project b868b7f8289047369b2fcbb500f353e5. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:52:42.788946 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Getting quotas for user 55d8e06905644ac39777328db72526ca and project b868b7f8289047369b2fcbb500f353e5. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:52:42.825152 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:52:42.833559 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:52:43.136243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d4a4143b-f243-4cbd-be9f-da7283cb1122 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.962271 Sep 08 13:52:43.142772 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 20/37] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:52:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 5970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:52:43.157623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5ba91708-245c-4852-81cf-e3a4b4a2f6c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:43.167820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5ba91708-245c-4852-81cf-e3a4b4a2f6c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:43.333282 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5ba91708-245c-4852-81cf-e3a4b4a2f6c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:43.356737 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5ba91708-245c-4852-81cf-e3a4b4a2f6c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1214 microversion: 2.1 time: 0.203177 Sep 08 13:52:43.358044 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 21/38] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:43 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:43.699901 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-161071194", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:43.781312 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e30bb1fd-b015-46e6-a647-d272f75c2dfa tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Action: 'create', calling method: .version_select at 0x7f5be5271dc0>, body: {"keypair": {"name": "tempest-keypair-940748884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk/7Xx5AQExBjnNVXElJjkjyJ8YtLfDwmwN6jNhvuk2IRumQYzGc+1WEM1r0FevF2YYZ0PmoKqqwhZHp9/RVCqbxNOLJFGuja0BoKQ8IEFb3Pi4bcfJnc3kSoOux9YzAg=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:43.846810 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-e30bb1fd-b015-46e6-a647-d272f75c2dfa tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Getting quotas for project 6998e0c9a62e4f54a27faf56dbeb543a. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:52:43.855878 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-e30bb1fd-b015-46e6-a647-d272f75c2dfa tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Getting quotas for user 96744eb6a9cf4895b6101e209d1fdd29 and project 6998e0c9a62e4f54a27faf56dbeb543a. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:52:43.914125 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] validate_networks() for [('a6ea2a7a-ef84-454a-b305-c470482cf7fa', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:52:43.971586 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e30bb1fd-b015-46e6-a647-d272f75c2dfa tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.610510 Sep 08 13:52:43.972963 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 22/39] 10.222.0.55 () {60 vars in 1159 bytes} [Thu Sep 8 13:52:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:44.380994 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b6bc827-6d5d-4e24-9462-1516d8c5326c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:44.382116 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b6bc827-6d5d-4e24-9462-1516d8c5326c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:44.521584 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9b6bc827-6d5d-4e24-9462-1516d8c5326c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:44.530959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b6bc827-6d5d-4e24-9462-1516d8c5326c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1214 microversion: 2.1 time: 0.153661 Sep 08 13:52:44.534520 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 23/40] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:44 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:52:45.475971 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1644213872", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf5901ef-2ee5-4879-85aa-18770c77b80a"}], "security_groups": [{"name": "tempest-securitygroup--1420323738"}], "key_name": "tempest-keypair-1559639221", "user_data": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:45.785030 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] validate_networks() for [('cf5901ef-2ee5-4879-85aa-18770c77b80a', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:52:47.099388 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:52:47.100004 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:52:47.105023 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:52:47.107897 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:52:47.108382 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:52:47.124634 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:47.127231 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:47.127927 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:47.129289 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:47.130213 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:47.131372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:47.179434 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for project b4ca185497284e9780eba8fc2e713d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:52:47.192659 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for user 2e48a8c1b91142cf9d1af17f28e41961 and project b4ca185497284e9780eba8fc2e713d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:52:47.223177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:52:47.226550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:52:47.336357 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83dbf2a3-28d9-4173-bc99-7e497cd665f1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.868882 Sep 08 13:52:47.345409 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 24/41] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:52:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:52:47.352642 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7aab83e3-c27f-4c35-a0e1-d7212236368f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:47.353925 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7aab83e3-c27f-4c35-a0e1-d7212236368f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:47.364345 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7aab83e3-c27f-4c35-a0e1-d7212236368f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:47.365325 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7aab83e3-c27f-4c35-a0e1-d7212236368f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:47.366252 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7aab83e3-c27f-4c35-a0e1-d7212236368f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:47.367630 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7aab83e3-c27f-4c35-a0e1-d7212236368f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:47.368337 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7aab83e3-c27f-4c35-a0e1-d7212236368f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:47.369145 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7aab83e3-c27f-4c35-a0e1-d7212236368f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:47.596679 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7aab83e3-c27f-4c35-a0e1-d7212236368f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:47.633725 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:52:47.635432 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:52:47.636075 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:52:47.637681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:52:47.638885 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:52:47.653002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7aab83e3-c27f-4c35-a0e1-d7212236368f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1266 microversion: 2.1 time: 0.304764 Sep 08 13:52:47.657317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 25/42] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:47 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:47.677471 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:47.678069 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb78e8e5-fa8f-4dba-bbfc-f9285c3417a0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:47.678531 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:47.679791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb78e8e5-fa8f-4dba-bbfc-f9285c3417a0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:47.681524 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:47.685478 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:47.688767 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:47.689435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:47.804035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Getting quotas for project 127bce2080d54fe4871b5aaa6cc394b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:52:47.810716 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Getting quotas for user 9f07158e4fd1430e839a1592e1e11b58 and project 127bce2080d54fe4871b5aaa6cc394b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:52:47.890575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb78e8e5-fa8f-4dba-bbfc-f9285c3417a0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:47.898652 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb78e8e5-fa8f-4dba-bbfc-f9285c3417a0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1242 microversion: 2.1 time: 0.239049 Sep 08 13:52:47.903728 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:52:47.922827 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 26/43] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:47 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1242 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:47.936646 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:52:48.139313 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0b145c9c-7bd4-4c69-874d-73ac075c44cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.055905 Sep 08 13:52:48.140681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 18/44] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:52:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 5058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:52:48.153067 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f6af7819-59ec-488e-8658-398994131629 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:48.153688 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f6af7819-59ec-488e-8658-398994131629 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:48.245167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-708048457", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96ff558b-c5db-4059-a363-a83e90cf91c8"}], "security_groups": [{"name": "tempest-securitygroup--1384505585"}], "key_name": "tempest-keypair-940748884", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:48.712000 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f6af7819-59ec-488e-8658-398994131629 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:48.723915 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f6af7819-59ec-488e-8658-398994131629 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1221 microversion: 2.1 time: 0.571838 Sep 08 13:52:48.724818 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 27/45] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:48 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1221 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:48.743205 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8cad41f3-eb40-4658-a41b-5fcee6a27119 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:48.744365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8cad41f3-eb40-4658-a41b-5fcee6a27119 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:48.770210 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cad41f3-eb40-4658-a41b-5fcee6a27119 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:48.778751 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cad41f3-eb40-4658-a41b-5fcee6a27119 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:48.779534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cad41f3-eb40-4658-a41b-5fcee6a27119 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:48.781460 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cad41f3-eb40-4658-a41b-5fcee6a27119 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:48.784028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cad41f3-eb40-4658-a41b-5fcee6a27119 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:48.785377 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8cad41f3-eb40-4658-a41b-5fcee6a27119 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:49.085979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8cad41f3-eb40-4658-a41b-5fcee6a27119 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:49.099172 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8cad41f3-eb40-4658-a41b-5fcee6a27119 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1272 microversion: 2.1 time: 0.372969 Sep 08 13:52:49.099859 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 28/46] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:48 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1272 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:49.125276 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9fd2c32d-2f39-410a-8ad4-63a65cea7018 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:49.134034 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9fd2c32d-2f39-410a-8ad4-63a65cea7018 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:49.141041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] validate_networks() for [('96ff558b-c5db-4059-a363-a83e90cf91c8', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:52:49.148046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd2c32d-2f39-410a-8ad4-63a65cea7018 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:49.156249 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd2c32d-2f39-410a-8ad4-63a65cea7018 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:49.157571 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd2c32d-2f39-410a-8ad4-63a65cea7018 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:49.160340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd2c32d-2f39-410a-8ad4-63a65cea7018 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:49.160986 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd2c32d-2f39-410a-8ad4-63a65cea7018 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:49.170900 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9fd2c32d-2f39-410a-8ad4-63a65cea7018 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:49.523112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9fd2c32d-2f39-410a-8ad4-63a65cea7018 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:49.539927 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9fd2c32d-2f39-410a-8ad4-63a65cea7018 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1246 microversion: 2.1 time: 0.427175 Sep 08 13:52:49.544199 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 29/47] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:49 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1246 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:49.561022 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-506756684", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:49.721492 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] validate_networks() for [('a6ea2a7a-ef84-454a-b305-c470482cf7fa', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:52:53.201334 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:52:53.203361 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:52:53.204139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:52:53.204687 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:52:53.205259 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:52:53.227857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:52:53.229014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:52:53.229703 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:52:53.230561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:52:53.231125 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:52:53.249544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:53.250063 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:53.261711 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:53.261909 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:53.262898 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:53.266340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:53.266869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:53.267932 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:53.269482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:53.274621 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:53.275246 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:53.275680 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:53.333651 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Getting quotas for project 127bce2080d54fe4871b5aaa6cc394b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:52:53.347030 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Getting quotas for user 9f07158e4fd1430e839a1592e1e11b58 and project 127bce2080d54fe4871b5aaa6cc394b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:52:53.352694 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Getting quotas for project 6998e0c9a62e4f54a27faf56dbeb543a. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:52:53.362082 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Getting quotas for user 96744eb6a9cf4895b6101e209d1fdd29 and project 6998e0c9a62e4f54a27faf56dbeb543a. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:52:53.398937 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:52:53.409634 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:52:53.412784 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:52:53.422249 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:52:53.561268 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5f53deb-1812-42b8-b61e-c5171ee5fb4d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.322520 Sep 08 13:52:53.571439 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b6771766-8c20-4405-a02a-6f82fbdb39cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.023928 Sep 08 13:52:53.572776 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 30/48] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:52:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 4027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:52:53.584801 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 19/49] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:52:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 5347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:52:53.609765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-34a0dfc6-6027-410b-8298-8165f48203a7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:53.616945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-34a0dfc6-6027-410b-8298-8165f48203a7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:53.630627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c95780bf-6379-4aec-8093-7c0582fae37f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:53.635697 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c95780bf-6379-4aec-8093-7c0582fae37f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:53.661370 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34a0dfc6-6027-410b-8298-8165f48203a7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:53.662428 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34a0dfc6-6027-410b-8298-8165f48203a7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:53.663127 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34a0dfc6-6027-410b-8298-8165f48203a7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:53.664047 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34a0dfc6-6027-410b-8298-8165f48203a7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:53.664773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34a0dfc6-6027-410b-8298-8165f48203a7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:53.666773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34a0dfc6-6027-410b-8298-8165f48203a7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:53.714446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c95780bf-6379-4aec-8093-7c0582fae37f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:53.723628 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c95780bf-6379-4aec-8093-7c0582fae37f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:53.724272 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c95780bf-6379-4aec-8093-7c0582fae37f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:53.725887 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c95780bf-6379-4aec-8093-7c0582fae37f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:53.726363 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c95780bf-6379-4aec-8093-7c0582fae37f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:53.726807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c95780bf-6379-4aec-8093-7c0582fae37f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:54.409246 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-34a0dfc6-6027-410b-8298-8165f48203a7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:54.498032 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-34a0dfc6-6027-410b-8298-8165f48203a7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1300 microversion: 2.1 time: 0.905459 Sep 08 13:52:54.500692 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 20/50] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:53 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1300 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:54.514454 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b55c4b2c-0dac-4fa6-afce-f161d971ee33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:54.516763 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b55c4b2c-0dac-4fa6-afce-f161d971ee33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:54.539205 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c95780bf-6379-4aec-8093-7c0582fae37f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:54.560059 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c95780bf-6379-4aec-8093-7c0582fae37f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1272 microversion: 2.1 time: 0.965032 Sep 08 13:52:54.564759 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 31/51] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:53 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1272 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:54.581860 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2bf59423-884a-4d5e-ab3d-859c4988d9de tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:54.585957 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2bf59423-884a-4d5e-ab3d-859c4988d9de tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:54.761799 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b55c4b2c-0dac-4fa6-afce-f161d971ee33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:54.808016 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b55c4b2c-0dac-4fa6-afce-f161d971ee33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1221 microversion: 2.1 time: 0.306121 Sep 08 13:52:54.808575 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 21/52] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:54 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1221 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:54.917168 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2bf59423-884a-4d5e-ab3d-859c4988d9de tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:54.928755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2bf59423-884a-4d5e-ab3d-859c4988d9de tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1236 microversion: 2.1 time: 0.359726 Sep 08 13:52:54.930760 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 32/53] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:54 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1236 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:55.527167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f185f5f-57a0-42c2-8f40-b07f0c1c8c94 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:55.528731 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f185f5f-57a0-42c2-8f40-b07f0c1c8c94 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:55.556791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f185f5f-57a0-42c2-8f40-b07f0c1c8c94 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:55.558275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f185f5f-57a0-42c2-8f40-b07f0c1c8c94 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:55.566075 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f185f5f-57a0-42c2-8f40-b07f0c1c8c94 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:55.567226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f185f5f-57a0-42c2-8f40-b07f0c1c8c94 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:55.568167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f185f5f-57a0-42c2-8f40-b07f0c1c8c94 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:55.571590 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f185f5f-57a0-42c2-8f40-b07f0c1c8c94 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:55.588698 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c67583e4-62b4-48c2-a4d2-99339609bb32 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:55.590402 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c67583e4-62b4-48c2-a4d2-99339609bb32 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:55.598701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67583e4-62b4-48c2-a4d2-99339609bb32 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:55.611563 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67583e4-62b4-48c2-a4d2-99339609bb32 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:55.615417 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67583e4-62b4-48c2-a4d2-99339609bb32 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:55.616605 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67583e4-62b4-48c2-a4d2-99339609bb32 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:55.617316 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67583e4-62b4-48c2-a4d2-99339609bb32 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:55.617940 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c67583e4-62b4-48c2-a4d2-99339609bb32 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:58.198021 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f185f5f-57a0-42c2-8f40-b07f0c1c8c94 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:58.213717 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f185f5f-57a0-42c2-8f40-b07f0c1c8c94 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 2.691375 Sep 08 13:52:58.216876 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 22/54] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:55 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 2695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:58.227640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c67583e4-62b4-48c2-a4d2-99339609bb32 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:58.240939 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fae4ddaf-0e0a-4728-a658-49255efcb7d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:58.241420 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c67583e4-62b4-48c2-a4d2-99339609bb32 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 2.653284 Sep 08 13:52:58.243622 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 33/55] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:55 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 2659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:58.246547 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fae4ddaf-0e0a-4728-a658-49255efcb7d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:58.260700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7fd35fa6-93c3-48cd-87b5-f06dd2945964 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:58.261718 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7fd35fa6-93c3-48cd-87b5-f06dd2945964 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:58.270414 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fae4ddaf-0e0a-4728-a658-49255efcb7d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:58.274998 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fae4ddaf-0e0a-4728-a658-49255efcb7d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:58.276157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fae4ddaf-0e0a-4728-a658-49255efcb7d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:58.278900 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fae4ddaf-0e0a-4728-a658-49255efcb7d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:58.281125 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fae4ddaf-0e0a-4728-a658-49255efcb7d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:58.283429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd35fa6-93c3-48cd-87b5-f06dd2945964 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:58.284349 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fae4ddaf-0e0a-4728-a658-49255efcb7d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:58.290205 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd35fa6-93c3-48cd-87b5-f06dd2945964 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:58.291019 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd35fa6-93c3-48cd-87b5-f06dd2945964 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:58.295715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd35fa6-93c3-48cd-87b5-f06dd2945964 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:58.298208 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd35fa6-93c3-48cd-87b5-f06dd2945964 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:58.299028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7fd35fa6-93c3-48cd-87b5-f06dd2945964 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:58.474201 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7fd35fa6-93c3-48cd-87b5-f06dd2945964 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:58.488307 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7fd35fa6-93c3-48cd-87b5-f06dd2945964 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1294 microversion: 2.1 time: 0.242159 Sep 08 13:52:58.491192 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 34/56] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:58 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1294 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:58.527246 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-fae4ddaf-0e0a-4728-a658-49255efcb7d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:58.550217 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fae4ddaf-0e0a-4728-a658-49255efcb7d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1273 microversion: 2.1 time: 0.331862 Sep 08 13:52:58.554385 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 23/57] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:58 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:59.244572 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8aaac12a-f4a5-47f6-a8b6-85968dc4317b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:59.245191 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8aaac12a-f4a5-47f6-a8b6-85968dc4317b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:59.268209 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b12da3ed-6712-4bd4-a19c-040be0bce51b tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:59.269477 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b12da3ed-6712-4bd4-a19c-040be0bce51b tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:59.286678 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8aaac12a-f4a5-47f6-a8b6-85968dc4317b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:59.289422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8aaac12a-f4a5-47f6-a8b6-85968dc4317b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:59.294750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12da3ed-6712-4bd4-a19c-040be0bce51b tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:59.295053 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8aaac12a-f4a5-47f6-a8b6-85968dc4317b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:59.295525 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12da3ed-6712-4bd4-a19c-040be0bce51b tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:59.296446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8aaac12a-f4a5-47f6-a8b6-85968dc4317b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:59.296940 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8aaac12a-f4a5-47f6-a8b6-85968dc4317b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:59.297304 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12da3ed-6712-4bd4-a19c-040be0bce51b tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:59.297427 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8aaac12a-f4a5-47f6-a8b6-85968dc4317b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:59.300487 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12da3ed-6712-4bd4-a19c-040be0bce51b tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:59.302605 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12da3ed-6712-4bd4-a19c-040be0bce51b tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:59.304677 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12da3ed-6712-4bd4-a19c-040be0bce51b tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:00.904118 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8aaac12a-f4a5-47f6-a8b6-85968dc4317b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:00.948584 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8aaac12a-f4a5-47f6-a8b6-85968dc4317b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 1.706599 Sep 08 13:53:00.956697 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 35/58] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:59 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:00.976110 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c106f876-1696-49bd-9940-99d2ef11e1a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:00.980466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c106f876-1696-49bd-9940-99d2ef11e1a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:01.009475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c106f876-1696-49bd-9940-99d2ef11e1a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:01.011395 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c106f876-1696-49bd-9940-99d2ef11e1a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:01.013438 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c106f876-1696-49bd-9940-99d2ef11e1a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:01.018201 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c106f876-1696-49bd-9940-99d2ef11e1a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:01.019355 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c106f876-1696-49bd-9940-99d2ef11e1a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:01.021622 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c106f876-1696-49bd-9940-99d2ef11e1a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:01.026199 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b12da3ed-6712-4bd4-a19c-040be0bce51b tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:01.051469 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b12da3ed-6712-4bd4-a19c-040be0bce51b tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 1.787138 Sep 08 13:53:01.054643 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 24/59] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:59 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:01.073323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b52bac1b-78fc-45e2-90aa-a0ea41072113 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:01.074784 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b52bac1b-78fc-45e2-90aa-a0ea41072113 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:01.102066 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52bac1b-78fc-45e2-90aa-a0ea41072113 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:01.102697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52bac1b-78fc-45e2-90aa-a0ea41072113 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:01.103143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52bac1b-78fc-45e2-90aa-a0ea41072113 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:01.106869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52bac1b-78fc-45e2-90aa-a0ea41072113 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:01.107611 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52bac1b-78fc-45e2-90aa-a0ea41072113 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:01.108066 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52bac1b-78fc-45e2-90aa-a0ea41072113 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:01.641258 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b52bac1b-78fc-45e2-90aa-a0ea41072113 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:01.666609 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b52bac1b-78fc-45e2-90aa-a0ea41072113 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1279 microversion: 2.1 time: 0.600491 Sep 08 13:53:01.675485 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c106f876-1696-49bd-9940-99d2ef11e1a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:01.682352 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 25/60] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:01 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1279 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:01.694867 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c106f876-1696-49bd-9940-99d2ef11e1a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1294 microversion: 2.1 time: 0.734768 Sep 08 13:53:01.698033 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 36/61] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:00 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1294 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:01.987418 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e5eccd9-0b39-45f1-b47f-2fd56633a051 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:01.990605 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0e5eccd9-0b39-45f1-b47f-2fd56633a051 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:02.012669 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e5eccd9-0b39-45f1-b47f-2fd56633a051 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:02.013280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e5eccd9-0b39-45f1-b47f-2fd56633a051 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:02.014042 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e5eccd9-0b39-45f1-b47f-2fd56633a051 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:02.015396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e5eccd9-0b39-45f1-b47f-2fd56633a051 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:02.016015 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e5eccd9-0b39-45f1-b47f-2fd56633a051 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:02.016700 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e5eccd9-0b39-45f1-b47f-2fd56633a051 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:02.218256 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2fca46ee-6289-45ec-bee7-8343f44ef0c9 req-aa18883d-17bd-42c4-b360-6d75ca66635b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a4e6c3b-d230-477f-b406-5f55ec596b1e", "tag": "2e9cdac8-d126-4ec3-8459-aaf58c0148d7"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:02.232729 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:02.255173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2fca46ee-6289-45ec-bee7-8343f44ef0c9 req-aa18883d-17bd-42c4-b360-6d75ca66635b service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:02.256776 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2fca46ee-6289-45ec-bee7-8343f44ef0c9 req-aa18883d-17bd-42c4-b360-6d75ca66635b service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:02.258387 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2fca46ee-6289-45ec-bee7-8343f44ef0c9 req-aa18883d-17bd-42c4-b360-6d75ca66635b service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:02.293208 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2fca46ee-6289-45ec-bee7-8343f44ef0c9 req-aa18883d-17bd-42c4-b360-6d75ca66635b service nova] Creating event network-changed:2e9cdac8-d126-4ec3-8459-aaf58c0148d7 for instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e on hv-cinder-82002 Sep 08 13:53:02.293998 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2fca46ee-6289-45ec-bee7-8343f44ef0c9 req-aa18883d-17bd-42c4-b360-6d75ca66635b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 13:53:02.294537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2fca46ee-6289-45ec-bee7-8343f44ef0c9 req-aa18883d-17bd-42c4-b360-6d75ca66635b service nova] Acquired lock "compute-rpcapi-router" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 13:53:02.295989 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d27e8f0-3d16-4ff6-b0e4-077a88af194b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:02.296601 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d27e8f0-3d16-4ff6-b0e4-077a88af194b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:02.298172 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d27e8f0-3d16-4ff6-b0e4-077a88af194b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:02.299782 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d27e8f0-3d16-4ff6-b0e4-077a88af194b None None] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:02.300475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d27e8f0-3d16-4ff6-b0e4-077a88af194b None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:02.301106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d27e8f0-3d16-4ff6-b0e4-077a88af194b None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:02.315488 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.compute.rpcapi [None req-5d27e8f0-3d16-4ff6-b0e4-077a88af194b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 13:53:02.316630 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d27e8f0-3d16-4ff6-b0e4-077a88af194b None None] Releasing lock "compute-rpcapi-router" {{(pid=126919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 13:53:02.340057 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5d27e8f0-3d16-4ff6-b0e4-077a88af194b None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325485 Sep 08 13:53:02.342401 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 37/62] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:02.352621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-612d5868-317f-4e22-ad45-c17505edf2e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:02.354259 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-612d5868-317f-4e22-ad45-c17505edf2e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:02.363279 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612d5868-317f-4e22-ad45-c17505edf2e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:02.364244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612d5868-317f-4e22-ad45-c17505edf2e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:02.365220 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612d5868-317f-4e22-ad45-c17505edf2e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:02.366108 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612d5868-317f-4e22-ad45-c17505edf2e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:02.366913 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612d5868-317f-4e22-ad45-c17505edf2e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:02.367469 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-612d5868-317f-4e22-ad45-c17505edf2e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:03.071927 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0e5eccd9-0b39-45f1-b47f-2fd56633a051 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:03.096609 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0e5eccd9-0b39-45f1-b47f-2fd56633a051 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 1.120818 Sep 08 13:53:03.119736 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 26/63] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:01 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:03.162367 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7ae1f7f7-20e4-4c52-8415-60e2a77b57cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:03.164949 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7ae1f7f7-20e4-4c52-8415-60e2a77b57cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:03.182351 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1f7f7-20e4-4c52-8415-60e2a77b57cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:03.183136 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1f7f7-20e4-4c52-8415-60e2a77b57cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:03.184807 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1f7f7-20e4-4c52-8415-60e2a77b57cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:03.189466 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1f7f7-20e4-4c52-8415-60e2a77b57cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:03.190759 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1f7f7-20e4-4c52-8415-60e2a77b57cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:03.192948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1f7f7-20e4-4c52-8415-60e2a77b57cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:03.310885 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:03.677763 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7ae1f7f7-20e4-4c52-8415-60e2a77b57cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:03.687095 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7ae1f7f7-20e4-4c52-8415-60e2a77b57cd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1279 microversion: 2.1 time: 0.565492 Sep 08 13:53:03.703597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 27/64] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:03 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1279 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:03.709680 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b2d5125b-2ce1-4cc0-94df-71548968fabd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:03.710949 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b2d5125b-2ce1-4cc0-94df-71548968fabd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:03.717040 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:03.719017 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2d5125b-2ce1-4cc0-94df-71548968fabd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:03.719508 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2d5125b-2ce1-4cc0-94df-71548968fabd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:03.719949 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2d5125b-2ce1-4cc0-94df-71548968fabd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:03.720712 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2d5125b-2ce1-4cc0-94df-71548968fabd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:03.721163 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2d5125b-2ce1-4cc0-94df-71548968fabd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:03.721580 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b2d5125b-2ce1-4cc0-94df-71548968fabd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:03.881069 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-612d5868-317f-4e22-ad45-c17505edf2e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:03.892683 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-612d5868-317f-4e22-ad45-c17505edf2e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 1.548718 Sep 08 13:53:03.895551 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 38/65] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:02 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:04.125679 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38684b57-9a81-4fda-a9f4-c90537596e1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:04.127380 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38684b57-9a81-4fda-a9f4-c90537596e1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:04.136257 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38684b57-9a81-4fda-a9f4-c90537596e1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:04.137073 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38684b57-9a81-4fda-a9f4-c90537596e1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:04.137749 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38684b57-9a81-4fda-a9f4-c90537596e1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:04.139031 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38684b57-9a81-4fda-a9f4-c90537596e1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:04.140500 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38684b57-9a81-4fda-a9f4-c90537596e1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:04.141628 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38684b57-9a81-4fda-a9f4-c90537596e1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:04.168773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b2d5125b-2ce1-4cc0-94df-71548968fabd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:04.178494 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b2d5125b-2ce1-4cc0-94df-71548968fabd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.473677 Sep 08 13:53:04.194108 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 28/66] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:03 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:04.390374 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-935e133b-2a54-48ac-b113-cc5296f2312a req-ba7059dc-cd1f-4ea8-837a-64fc7ca39237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a4b8e4-4292-4db0-89b6-b09f84f513ce", "tag": "94671fa2-8c0f-46c1-8d8a-12ec57a1598d"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:04.404771 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-935e133b-2a54-48ac-b113-cc5296f2312a req-ba7059dc-cd1f-4ea8-837a-64fc7ca39237 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:04.405256 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-935e133b-2a54-48ac-b113-cc5296f2312a req-ba7059dc-cd1f-4ea8-837a-64fc7ca39237 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:04.405682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-935e133b-2a54-48ac-b113-cc5296f2312a req-ba7059dc-cd1f-4ea8-837a-64fc7ca39237 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:04.428559 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-935e133b-2a54-48ac-b113-cc5296f2312a req-ba7059dc-cd1f-4ea8-837a-64fc7ca39237 service nova] Creating event network-changed:94671fa2-8c0f-46c1-8d8a-12ec57a1598d for instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce on hv-cinder-82002 Sep 08 13:53:04.429089 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-935e133b-2a54-48ac-b113-cc5296f2312a req-ba7059dc-cd1f-4ea8-837a-64fc7ca39237 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 13:53:04.429473 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-935e133b-2a54-48ac-b113-cc5296f2312a req-ba7059dc-cd1f-4ea8-837a-64fc7ca39237 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 13:53:04.430573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7c1f2ee-4e77-409d-b98a-eabe30869dcc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:04.431029 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7c1f2ee-4e77-409d-b98a-eabe30869dcc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:04.431453 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7c1f2ee-4e77-409d-b98a-eabe30869dcc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:04.432334 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7c1f2ee-4e77-409d-b98a-eabe30869dcc None None] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:04.432795 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7c1f2ee-4e77-409d-b98a-eabe30869dcc None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:04.433210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7c1f2ee-4e77-409d-b98a-eabe30869dcc None None] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:04.445861 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.compute.rpcapi [None req-d7c1f2ee-4e77-409d-b98a-eabe30869dcc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 13:53:04.447385 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d7c1f2ee-4e77-409d-b98a-eabe30869dcc None None] Releasing lock "compute-rpcapi-router" {{(pid=126920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 13:53:04.467838 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d7c1f2ee-4e77-409d-b98a-eabe30869dcc None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081923 Sep 08 13:53:04.468880 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 29/67] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:53:04.717500 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a48fcf02-5c90-457d-971e-bdc6d9ca57cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:04.718738 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a48fcf02-5c90-457d-971e-bdc6d9ca57cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:04.737444 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a48fcf02-5c90-457d-971e-bdc6d9ca57cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:04.738667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a48fcf02-5c90-457d-971e-bdc6d9ca57cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:04.740204 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a48fcf02-5c90-457d-971e-bdc6d9ca57cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:04.740995 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a48fcf02-5c90-457d-971e-bdc6d9ca57cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:04.741470 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a48fcf02-5c90-457d-971e-bdc6d9ca57cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:04.746088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a48fcf02-5c90-457d-971e-bdc6d9ca57cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:04.807531 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=18 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:04.926915 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=32 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:05.015164 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-38684b57-9a81-4fda-a9f4-c90537596e1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:05.026154 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38684b57-9a81-4fda-a9f4-c90537596e1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.905227 Sep 08 13:53:05.028071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 39/68] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:04 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:05.035708 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84dcb8ea-2b53-4d48-8deb-47f5ad4f8e54 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:05.036332 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84dcb8ea-2b53-4d48-8deb-47f5ad4f8e54 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:05.042891 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84dcb8ea-2b53-4d48-8deb-47f5ad4f8e54 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:05.043658 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84dcb8ea-2b53-4d48-8deb-47f5ad4f8e54 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:05.044519 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84dcb8ea-2b53-4d48-8deb-47f5ad4f8e54 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:05.045551 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84dcb8ea-2b53-4d48-8deb-47f5ad4f8e54 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:05.046166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84dcb8ea-2b53-4d48-8deb-47f5ad4f8e54 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:05.046820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84dcb8ea-2b53-4d48-8deb-47f5ad4f8e54 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:05.367472 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a48fcf02-5c90-457d-971e-bdc6d9ca57cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:05.388382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a48fcf02-5c90-457d-971e-bdc6d9ca57cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.676259 Sep 08 13:53:05.397958 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 30/69] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:04 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:05.450781 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-84dcb8ea-2b53-4d48-8deb-47f5ad4f8e54 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:05.460386 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84dcb8ea-2b53-4d48-8deb-47f5ad4f8e54 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.430602 Sep 08 13:53:05.466189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 40/70] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:05 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:05.471661 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e9fd2d58-c8ac-43ae-a301-7e9ca8ced137 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:05.478172 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e9fd2d58-c8ac-43ae-a301-7e9ca8ced137 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:05.492442 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9fd2d58-c8ac-43ae-a301-7e9ca8ced137 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:05.495702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9fd2d58-c8ac-43ae-a301-7e9ca8ced137 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:05.496428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9fd2d58-c8ac-43ae-a301-7e9ca8ced137 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:05.497598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9fd2d58-c8ac-43ae-a301-7e9ca8ced137 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:05.499857 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9fd2d58-c8ac-43ae-a301-7e9ca8ced137 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:05.500404 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9fd2d58-c8ac-43ae-a301-7e9ca8ced137 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:05.706916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0057c344-d4f9-4703-a9a9-e6c7ba3ab4af req-4377895c-b9c1-4d1f-81a2-8c4f3b10f0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c", "tag": "8264f39d-725c-426b-913c-05ab5ad2087e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:05.734622 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0057c344-d4f9-4703-a9a9-e6c7ba3ab4af req-4377895c-b9c1-4d1f-81a2-8c4f3b10f0f3 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:05.739915 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0057c344-d4f9-4703-a9a9-e6c7ba3ab4af req-4377895c-b9c1-4d1f-81a2-8c4f3b10f0f3 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:05.741809 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0057c344-d4f9-4703-a9a9-e6c7ba3ab4af req-4377895c-b9c1-4d1f-81a2-8c4f3b10f0f3 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:05.762673 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e9fd2d58-c8ac-43ae-a301-7e9ca8ced137 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:05.770454 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e9fd2d58-c8ac-43ae-a301-7e9ca8ced137 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.302450 Sep 08 13:53:05.773368 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 41/71] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:05 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:05.776304 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0057c344-d4f9-4703-a9a9-e6c7ba3ab4af req-4377895c-b9c1-4d1f-81a2-8c4f3b10f0f3 service nova] Creating event network-changed:8264f39d-725c-426b-913c-05ab5ad2087e for instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c on hv-cinder-82002 Sep 08 13:53:05.790995 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0057c344-d4f9-4703-a9a9-e6c7ba3ab4af req-4377895c-b9c1-4d1f-81a2-8c4f3b10f0f3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391770 Sep 08 13:53:05.792209 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 31/72] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:06.050948 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65d33d6f-3cb4-46e3-be96-a94a685d4654 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:06.051716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65d33d6f-3cb4-46e3-be96-a94a685d4654 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:06.058154 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d33d6f-3cb4-46e3-be96-a94a685d4654 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:06.058891 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d33d6f-3cb4-46e3-be96-a94a685d4654 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:06.059562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d33d6f-3cb4-46e3-be96-a94a685d4654 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:06.060470 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d33d6f-3cb4-46e3-be96-a94a685d4654 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:06.061129 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d33d6f-3cb4-46e3-be96-a94a685d4654 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:06.061950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65d33d6f-3cb4-46e3-be96-a94a685d4654 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:06.345425 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-65d33d6f-3cb4-46e3-be96-a94a685d4654 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:06.356463 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65d33d6f-3cb4-46e3-be96-a94a685d4654 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.309015 Sep 08 13:53:06.373372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 42/73] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:06 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:06.424162 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a7a8808-1478-4b35-83b6-3fbc6bb84148 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:06.424945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0a7a8808-1478-4b35-83b6-3fbc6bb84148 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:06.439259 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a7a8808-1478-4b35-83b6-3fbc6bb84148 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:06.440013 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a7a8808-1478-4b35-83b6-3fbc6bb84148 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:06.440522 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a7a8808-1478-4b35-83b6-3fbc6bb84148 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:06.441404 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a7a8808-1478-4b35-83b6-3fbc6bb84148 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:06.442081 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a7a8808-1478-4b35-83b6-3fbc6bb84148 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:06.443481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a7a8808-1478-4b35-83b6-3fbc6bb84148 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:06.489862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e8468fd-dd51-4b66-a9fa-8d949b23f1e4 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:06.490679 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e8468fd-dd51-4b66-a9fa-8d949b23f1e4 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:06.497134 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e8468fd-dd51-4b66-a9fa-8d949b23f1e4 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:06.497608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e8468fd-dd51-4b66-a9fa-8d949b23f1e4 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:06.498061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e8468fd-dd51-4b66-a9fa-8d949b23f1e4 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:06.499510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e8468fd-dd51-4b66-a9fa-8d949b23f1e4 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:06.500108 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e8468fd-dd51-4b66-a9fa-8d949b23f1e4 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:06.500999 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e8468fd-dd51-4b66-a9fa-8d949b23f1e4 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:06.626100 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a7a8808-1478-4b35-83b6-3fbc6bb84148 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:06.637657 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a7a8808-1478-4b35-83b6-3fbc6bb84148 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.227837 Sep 08 13:53:06.638429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 32/74] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:06 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:06.694488 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e8468fd-dd51-4b66-a9fa-8d949b23f1e4 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:06.703344 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e8468fd-dd51-4b66-a9fa-8d949b23f1e4 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.218514 Sep 08 13:53:06.704411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 43/75] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:06 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:06.796921 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2d3f3e59-7698-4016-aff9-f9124a73dc02 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:06.797832 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2d3f3e59-7698-4016-aff9-f9124a73dc02 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:06.806129 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3f3e59-7698-4016-aff9-f9124a73dc02 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:06.806726 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3f3e59-7698-4016-aff9-f9124a73dc02 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:06.807343 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3f3e59-7698-4016-aff9-f9124a73dc02 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:06.808487 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3f3e59-7698-4016-aff9-f9124a73dc02 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:06.809172 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3f3e59-7698-4016-aff9-f9124a73dc02 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:06.809905 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d3f3e59-7698-4016-aff9-f9124a73dc02 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:06.981226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2d3f3e59-7698-4016-aff9-f9124a73dc02 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:06.995995 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2d3f3e59-7698-4016-aff9-f9124a73dc02 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.202937 Sep 08 13:53:06.997384 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 33/76] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:06 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:07.383437 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e930f291-e91a-4ceb-bc16-9b4f0ea2e979 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:07.384171 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e930f291-e91a-4ceb-bc16-9b4f0ea2e979 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:07.390979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e930f291-e91a-4ceb-bc16-9b4f0ea2e979 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:07.391723 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e930f291-e91a-4ceb-bc16-9b4f0ea2e979 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:07.392337 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e930f291-e91a-4ceb-bc16-9b4f0ea2e979 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:07.393075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e930f291-e91a-4ceb-bc16-9b4f0ea2e979 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:07.393533 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e930f291-e91a-4ceb-bc16-9b4f0ea2e979 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:07.393981 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e930f291-e91a-4ceb-bc16-9b4f0ea2e979 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:07.547261 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e930f291-e91a-4ceb-bc16-9b4f0ea2e979 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:07.553186 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:07.559846 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e930f291-e91a-4ceb-bc16-9b4f0ea2e979 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.180450 Sep 08 13:53:07.560637 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 44/77] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:07 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:07.661068 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a5ffc928-65bd-4e48-b483-9f35256d5a4c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:07.661562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a5ffc928-65bd-4e48-b483-9f35256d5a4c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:07.667867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5ffc928-65bd-4e48-b483-9f35256d5a4c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:07.668538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5ffc928-65bd-4e48-b483-9f35256d5a4c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:07.668967 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5ffc928-65bd-4e48-b483-9f35256d5a4c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:07.669866 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5ffc928-65bd-4e48-b483-9f35256d5a4c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:07.670316 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5ffc928-65bd-4e48-b483-9f35256d5a4c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:07.670930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a5ffc928-65bd-4e48-b483-9f35256d5a4c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:07.734987 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3eb57963-ea53-4da5-951d-19a04f996b2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:07.735666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3eb57963-ea53-4da5-951d-19a04f996b2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:07.742122 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb57963-ea53-4da5-951d-19a04f996b2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:07.742608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb57963-ea53-4da5-951d-19a04f996b2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:07.743070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb57963-ea53-4da5-951d-19a04f996b2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:07.743772 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb57963-ea53-4da5-951d-19a04f996b2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:07.744228 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb57963-ea53-4da5-951d-19a04f996b2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:07.744650 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eb57963-ea53-4da5-951d-19a04f996b2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:07.892494 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a5ffc928-65bd-4e48-b483-9f35256d5a4c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:07.909429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a5ffc928-65bd-4e48-b483-9f35256d5a4c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.252413 Sep 08 13:53:07.910116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 34/78] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:07 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:07.915296 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-94fc94b0-dd19-482c-a93a-bd496ee8f751 req-6bd2a7df-e7b7-4bb9-9b9f-360edf4a199e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ad7906-3b73-4fc9-a692-9692fb6234b3", "tag": "86699af9-4b49-40e3-b189-ff4a7a9e5e59"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:07.927012 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-94fc94b0-dd19-482c-a93a-bd496ee8f751 req-6bd2a7df-e7b7-4bb9-9b9f-360edf4a199e service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:07.927738 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-94fc94b0-dd19-482c-a93a-bd496ee8f751 req-6bd2a7df-e7b7-4bb9-9b9f-360edf4a199e service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:07.928472 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-94fc94b0-dd19-482c-a93a-bd496ee8f751 req-6bd2a7df-e7b7-4bb9-9b9f-360edf4a199e service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:07.940487 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-94fc94b0-dd19-482c-a93a-bd496ee8f751 req-6bd2a7df-e7b7-4bb9-9b9f-360edf4a199e service nova] Creating event network-changed:86699af9-4b49-40e3-b189-ff4a7a9e5e59 for instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 on hv-cinder-82002 Sep 08 13:53:07.946107 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-94fc94b0-dd19-482c-a93a-bd496ee8f751 req-6bd2a7df-e7b7-4bb9-9b9f-360edf4a199e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034834 Sep 08 13:53:07.947282 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 35/79] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:07.965456 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3eb57963-ea53-4da5-951d-19a04f996b2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:07.976341 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3eb57963-ea53-4da5-951d-19a04f996b2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.246656 Sep 08 13:53:07.977002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 45/80] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:07 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:08.021141 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ac3541b-e3fa-4bbc-a44a-a044fbd00978 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:08.022081 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ac3541b-e3fa-4bbc-a44a-a044fbd00978 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:08.029190 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ac3541b-e3fa-4bbc-a44a-a044fbd00978 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:08.029986 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ac3541b-e3fa-4bbc-a44a-a044fbd00978 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:08.030600 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ac3541b-e3fa-4bbc-a44a-a044fbd00978 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:08.032208 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ac3541b-e3fa-4bbc-a44a-a044fbd00978 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:08.032668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ac3541b-e3fa-4bbc-a44a-a044fbd00978 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:08.033276 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ac3541b-e3fa-4bbc-a44a-a044fbd00978 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:08.195384 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ac3541b-e3fa-4bbc-a44a-a044fbd00978 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:08.207637 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ac3541b-e3fa-4bbc-a44a-a044fbd00978 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.191288 Sep 08 13:53:08.208672 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 36/81] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:08 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:08.583998 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d69c2474-da07-43c1-8956-153754197be2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:08.584940 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d69c2474-da07-43c1-8956-153754197be2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:08.590939 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d69c2474-da07-43c1-8956-153754197be2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:08.591416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d69c2474-da07-43c1-8956-153754197be2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:08.591842 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d69c2474-da07-43c1-8956-153754197be2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:08.593274 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d69c2474-da07-43c1-8956-153754197be2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:08.594074 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d69c2474-da07-43c1-8956-153754197be2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:08.594532 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d69c2474-da07-43c1-8956-153754197be2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:08.735606 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d69c2474-da07-43c1-8956-153754197be2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:08.743301 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d69c2474-da07-43c1-8956-153754197be2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.163447 Sep 08 13:53:08.743882 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 46/82] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:08 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:08.932642 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d85e6d6d-a687-420f-a124-ba4102420ede tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:08.933271 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d85e6d6d-a687-420f-a124-ba4102420ede tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:08.940966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d85e6d6d-a687-420f-a124-ba4102420ede tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:08.941449 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d85e6d6d-a687-420f-a124-ba4102420ede tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:08.941916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d85e6d6d-a687-420f-a124-ba4102420ede tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:08.942608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d85e6d6d-a687-420f-a124-ba4102420ede tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:08.943055 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d85e6d6d-a687-420f-a124-ba4102420ede tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:08.943470 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d85e6d6d-a687-420f-a124-ba4102420ede tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:09.001977 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b1078799-7444-4d97-9357-386431c59354 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:09.002843 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b1078799-7444-4d97-9357-386431c59354 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:09.012857 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1078799-7444-4d97-9357-386431c59354 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:09.013720 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1078799-7444-4d97-9357-386431c59354 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:09.016402 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1078799-7444-4d97-9357-386431c59354 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:09.017307 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1078799-7444-4d97-9357-386431c59354 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:09.018826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1078799-7444-4d97-9357-386431c59354 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:09.019429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1078799-7444-4d97-9357-386431c59354 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:09.152557 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d85e6d6d-a687-420f-a124-ba4102420ede tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:09.164242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d85e6d6d-a687-420f-a124-ba4102420ede tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.235429 Sep 08 13:53:09.165075 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 37/83] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:08 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:09.208101 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b1078799-7444-4d97-9357-386431c59354 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:09.216494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b1078799-7444-4d97-9357-386431c59354 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.219926 Sep 08 13:53:09.217061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 47/84] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:08 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:09.234134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-25bc4d34-6b0d-49f6-8cbc-7e7110da203a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:09.234759 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-25bc4d34-6b0d-49f6-8cbc-7e7110da203a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:09.240564 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25bc4d34-6b0d-49f6-8cbc-7e7110da203a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:09.241047 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25bc4d34-6b0d-49f6-8cbc-7e7110da203a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:09.241485 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25bc4d34-6b0d-49f6-8cbc-7e7110da203a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:09.242210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25bc4d34-6b0d-49f6-8cbc-7e7110da203a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:09.242665 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25bc4d34-6b0d-49f6-8cbc-7e7110da203a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:09.243086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-25bc4d34-6b0d-49f6-8cbc-7e7110da203a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:09.263589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:09.379517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-25bc4d34-6b0d-49f6-8cbc-7e7110da203a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:09.387717 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-25bc4d34-6b0d-49f6-8cbc-7e7110da203a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.157960 Sep 08 13:53:09.388345 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 38/85] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:09 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:09.768213 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1508426-715a-40e0-906f-b36642eb4edc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:09.768799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a1508426-715a-40e0-906f-b36642eb4edc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:09.774668 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1508426-715a-40e0-906f-b36642eb4edc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:09.775148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1508426-715a-40e0-906f-b36642eb4edc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:09.775604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1508426-715a-40e0-906f-b36642eb4edc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:09.776312 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1508426-715a-40e0-906f-b36642eb4edc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:09.776745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1508426-715a-40e0-906f-b36642eb4edc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:09.777158 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1508426-715a-40e0-906f-b36642eb4edc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:09.917132 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a1508426-715a-40e0-906f-b36642eb4edc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:09.925212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a1508426-715a-40e0-906f-b36642eb4edc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.163226 Sep 08 13:53:09.926143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 48/86] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:09 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:10.189700 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1eaa2222-a4ed-4086-b5ec-81c36977ae04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:10.191227 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1eaa2222-a4ed-4086-b5ec-81c36977ae04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:10.197602 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eaa2222-a4ed-4086-b5ec-81c36977ae04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:10.198345 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eaa2222-a4ed-4086-b5ec-81c36977ae04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:10.198950 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eaa2222-a4ed-4086-b5ec-81c36977ae04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:10.202604 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eaa2222-a4ed-4086-b5ec-81c36977ae04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:10.203269 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eaa2222-a4ed-4086-b5ec-81c36977ae04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:10.203849 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1eaa2222-a4ed-4086-b5ec-81c36977ae04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:10.240499 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a2e6f78e-cf60-4bda-b788-bf70c461ef71 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:10.241111 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a2e6f78e-cf60-4bda-b788-bf70c461ef71 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:10.251389 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2e6f78e-cf60-4bda-b788-bf70c461ef71 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:10.251890 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2e6f78e-cf60-4bda-b788-bf70c461ef71 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:10.252323 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2e6f78e-cf60-4bda-b788-bf70c461ef71 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:10.253027 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2e6f78e-cf60-4bda-b788-bf70c461ef71 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:10.253473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2e6f78e-cf60-4bda-b788-bf70c461ef71 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:10.253926 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2e6f78e-cf60-4bda-b788-bf70c461ef71 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:11.244335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a2e6f78e-cf60-4bda-b788-bf70c461ef71 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:11.246967 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1eaa2222-a4ed-4086-b5ec-81c36977ae04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:11.259154 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a2e6f78e-cf60-4bda-b788-bf70c461ef71 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 1.022224 Sep 08 13:53:11.260002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 49/87] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:10 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:11.267644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86dba3f5-87a5-44be-807f-df2cd0b657a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:11.268970 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86dba3f5-87a5-44be-807f-df2cd0b657a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:11.273918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1eaa2222-a4ed-4086-b5ec-81c36977ae04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 1.088226 Sep 08 13:53:11.285774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86dba3f5-87a5-44be-807f-df2cd0b657a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:11.286517 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86dba3f5-87a5-44be-807f-df2cd0b657a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:11.287127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86dba3f5-87a5-44be-807f-df2cd0b657a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:11.287846 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86dba3f5-87a5-44be-807f-df2cd0b657a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:11.288301 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86dba3f5-87a5-44be-807f-df2cd0b657a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:11.288725 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86dba3f5-87a5-44be-807f-df2cd0b657a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:11.289552 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 39/88] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:10 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:11.307504 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da6153d9-8b0e-475e-9129-608df81bd944 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:11.308119 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-da6153d9-8b0e-475e-9129-608df81bd944 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:11.321319 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da6153d9-8b0e-475e-9129-608df81bd944 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:11.322226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da6153d9-8b0e-475e-9129-608df81bd944 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:11.323018 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da6153d9-8b0e-475e-9129-608df81bd944 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:11.325247 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da6153d9-8b0e-475e-9129-608df81bd944 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:11.325923 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da6153d9-8b0e-475e-9129-608df81bd944 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:11.326521 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da6153d9-8b0e-475e-9129-608df81bd944 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:11.630060 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-86dba3f5-87a5-44be-807f-df2cd0b657a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:11.638035 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86dba3f5-87a5-44be-807f-df2cd0b657a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.376965 Sep 08 13:53:11.638800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 50/89] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:11 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:11.679443 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-da6153d9-8b0e-475e-9129-608df81bd944 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:11.689422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da6153d9-8b0e-475e-9129-608df81bd944 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.399019 Sep 08 13:53:11.690045 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 40/90] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:11 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:11.946032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-d8c03107-e3cf-4424-aa15-6a6a5f3063b1 req-d8733acb-e5de-4e33-a3e3-2544dfb1d975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17665f83-a581-4f16-9275-45bce05f5f49", "tag": "5c7e423f-8bb5-4a1a-a739-7918f898d812"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:11.955748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d8c03107-e3cf-4424-aa15-6a6a5f3063b1 req-d8733acb-e5de-4e33-a3e3-2544dfb1d975 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:11.956483 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d8c03107-e3cf-4424-aa15-6a6a5f3063b1 req-d8733acb-e5de-4e33-a3e3-2544dfb1d975 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:11.956899 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d8c03107-e3cf-4424-aa15-6a6a5f3063b1 req-d8733acb-e5de-4e33-a3e3-2544dfb1d975 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:11.969842 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-d8c03107-e3cf-4424-aa15-6a6a5f3063b1 req-d8733acb-e5de-4e33-a3e3-2544dfb1d975 service nova] Creating event network-changed:5c7e423f-8bb5-4a1a-a739-7918f898d812 for instance 17665f83-a581-4f16-9275-45bce05f5f49 on hv-cinder-82002 Sep 08 13:53:11.974974 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-d8c03107-e3cf-4424-aa15-6a6a5f3063b1 req-d8733acb-e5de-4e33-a3e3-2544dfb1d975 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032706 Sep 08 13:53:11.975569 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 51/91] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:12.292659 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-390ad41d-3d9c-425c-ae9f-053f7652ade8 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:12.294047 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-390ad41d-3d9c-425c-ae9f-053f7652ade8 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:12.302525 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390ad41d-3d9c-425c-ae9f-053f7652ade8 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:12.303439 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390ad41d-3d9c-425c-ae9f-053f7652ade8 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:12.304096 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390ad41d-3d9c-425c-ae9f-053f7652ade8 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:12.304996 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390ad41d-3d9c-425c-ae9f-053f7652ade8 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:12.305648 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390ad41d-3d9c-425c-ae9f-053f7652ade8 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:12.306066 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-afd2be46-ecaf-4c31-8cb8-3b056b709772 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:12.306508 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390ad41d-3d9c-425c-ae9f-053f7652ade8 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:12.307384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-afd2be46-ecaf-4c31-8cb8-3b056b709772 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:12.311033 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:12.317786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afd2be46-ecaf-4c31-8cb8-3b056b709772 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:12.318654 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afd2be46-ecaf-4c31-8cb8-3b056b709772 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:12.319293 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afd2be46-ecaf-4c31-8cb8-3b056b709772 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:12.320213 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afd2be46-ecaf-4c31-8cb8-3b056b709772 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:12.321082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afd2be46-ecaf-4c31-8cb8-3b056b709772 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:12.321706 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afd2be46-ecaf-4c31-8cb8-3b056b709772 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:12.495034 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-390ad41d-3d9c-425c-ae9f-053f7652ade8 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:12.503676 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-390ad41d-3d9c-425c-ae9f-053f7652ade8 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.217472 Sep 08 13:53:12.504664 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 41/92] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:12 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:12.554323 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-afd2be46-ecaf-4c31-8cb8-3b056b709772 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:12.562795 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-afd2be46-ecaf-4c31-8cb8-3b056b709772 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.260786 Sep 08 13:53:12.563537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 52/93] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:12 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:12.663170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5980b31b-a256-4d84-831d-a881ee306b59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:12.665042 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5980b31b-a256-4d84-831d-a881ee306b59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:12.674033 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5980b31b-a256-4d84-831d-a881ee306b59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:12.674719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5980b31b-a256-4d84-831d-a881ee306b59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:12.675369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5980b31b-a256-4d84-831d-a881ee306b59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:12.676704 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5980b31b-a256-4d84-831d-a881ee306b59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:12.677916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5980b31b-a256-4d84-831d-a881ee306b59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:12.678424 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5980b31b-a256-4d84-831d-a881ee306b59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:12.713791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1669a57e-1968-4faf-8d8f-ac00e181ec35 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:12.714536 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1669a57e-1968-4faf-8d8f-ac00e181ec35 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:12.721490 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1669a57e-1968-4faf-8d8f-ac00e181ec35 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:12.722009 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1669a57e-1968-4faf-8d8f-ac00e181ec35 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:12.722443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1669a57e-1968-4faf-8d8f-ac00e181ec35 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:12.723136 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1669a57e-1968-4faf-8d8f-ac00e181ec35 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:12.723593 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1669a57e-1968-4faf-8d8f-ac00e181ec35 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:12.724006 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1669a57e-1968-4faf-8d8f-ac00e181ec35 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:12.971912 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5980b31b-a256-4d84-831d-a881ee306b59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:12.980381 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5980b31b-a256-4d84-831d-a881ee306b59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.322966 Sep 08 13:53:12.981263 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 42/94] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:12 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:12.988297 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-1669a57e-1968-4faf-8d8f-ac00e181ec35 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:12.996557 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1669a57e-1968-4faf-8d8f-ac00e181ec35 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.287575 Sep 08 13:53:12.997132 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 53/95] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:12 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:13.528682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cc52fe9a-3a5b-46f9-ac15-1478cbcb449f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:13.536129 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cc52fe9a-3a5b-46f9-ac15-1478cbcb449f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:13.550430 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc52fe9a-3a5b-46f9-ac15-1478cbcb449f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:13.551899 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc52fe9a-3a5b-46f9-ac15-1478cbcb449f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:13.552412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc52fe9a-3a5b-46f9-ac15-1478cbcb449f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:13.553207 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc52fe9a-3a5b-46f9-ac15-1478cbcb449f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:13.553782 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc52fe9a-3a5b-46f9-ac15-1478cbcb449f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:13.554481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cc52fe9a-3a5b-46f9-ac15-1478cbcb449f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:13.586347 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2a668b86-7d74-4833-aba9-cfc1c667a84f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:13.586954 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a668b86-7d74-4833-aba9-cfc1c667a84f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:13.593510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a668b86-7d74-4833-aba9-cfc1c667a84f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:13.594133 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a668b86-7d74-4833-aba9-cfc1c667a84f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:13.595352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a668b86-7d74-4833-aba9-cfc1c667a84f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:13.596072 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a668b86-7d74-4833-aba9-cfc1c667a84f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:13.596600 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a668b86-7d74-4833-aba9-cfc1c667a84f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:13.597140 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a668b86-7d74-4833-aba9-cfc1c667a84f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:13.860590 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cc52fe9a-3a5b-46f9-ac15-1478cbcb449f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:13.870631 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a668b86-7d74-4833-aba9-cfc1c667a84f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:13.874850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cc52fe9a-3a5b-46f9-ac15-1478cbcb449f tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.348843 Sep 08 13:53:13.880428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2a668b86-7d74-4833-aba9-cfc1c667a84f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.298593 Sep 08 13:53:13.883136 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 54/96] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:13 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:13.890064 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 43/97] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:13 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:14.006164 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97015ac1-0da7-4373-8866-4c092bafb168 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:14.007211 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-97015ac1-0da7-4373-8866-4c092bafb168 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:14.025161 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6873e83d-6dd3-436b-85ae-1675bf38d1c1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:14.026376 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6873e83d-6dd3-436b-85ae-1675bf38d1c1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:14.049850 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97015ac1-0da7-4373-8866-4c092bafb168 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:14.050626 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97015ac1-0da7-4373-8866-4c092bafb168 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:14.051683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6873e83d-6dd3-436b-85ae-1675bf38d1c1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:14.053221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97015ac1-0da7-4373-8866-4c092bafb168 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:14.056653 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6873e83d-6dd3-436b-85ae-1675bf38d1c1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:14.063824 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97015ac1-0da7-4373-8866-4c092bafb168 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:14.064307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6873e83d-6dd3-436b-85ae-1675bf38d1c1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:14.065459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97015ac1-0da7-4373-8866-4c092bafb168 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:14.065942 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97015ac1-0da7-4373-8866-4c092bafb168 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:14.066916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6873e83d-6dd3-436b-85ae-1675bf38d1c1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:14.067414 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6873e83d-6dd3-436b-85ae-1675bf38d1c1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:14.070810 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6873e83d-6dd3-436b-85ae-1675bf38d1c1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:14.444243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:14.826736 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-6873e83d-6dd3-436b-85ae-1675bf38d1c1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:14.839984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6873e83d-6dd3-436b-85ae-1675bf38d1c1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.824211 Sep 08 13:53:14.840614 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 44/98] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:14 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:14.888425 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-97015ac1-0da7-4373-8866-4c092bafb168 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:14.912726 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-593c4bba-153e-44cc-8f1a-a7ca51b347e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:14.913351 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-593c4bba-153e-44cc-8f1a-a7ca51b347e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:14.923956 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-97015ac1-0da7-4373-8866-4c092bafb168 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.923007 Sep 08 13:53:14.929506 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 55/99] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:13 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:14.930757 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593c4bba-153e-44cc-8f1a-a7ca51b347e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:14.935594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb9f4387-99cd-40af-93c4-d44e261f772b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:14.936707 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eb9f4387-99cd-40af-93c4-d44e261f772b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:14.940250 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593c4bba-153e-44cc-8f1a-a7ca51b347e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:14.940693 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593c4bba-153e-44cc-8f1a-a7ca51b347e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:14.941431 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593c4bba-153e-44cc-8f1a-a7ca51b347e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:14.941920 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593c4bba-153e-44cc-8f1a-a7ca51b347e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:14.947564 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-593c4bba-153e-44cc-8f1a-a7ca51b347e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:14.970139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9f4387-99cd-40af-93c4-d44e261f772b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:14.970633 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9f4387-99cd-40af-93c4-d44e261f772b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:14.971061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9f4387-99cd-40af-93c4-d44e261f772b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:14.971766 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9f4387-99cd-40af-93c4-d44e261f772b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:14.972207 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9f4387-99cd-40af-93c4-d44e261f772b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:14.979774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9f4387-99cd-40af-93c4-d44e261f772b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:15.213633 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-593c4bba-153e-44cc-8f1a-a7ca51b347e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:15.222210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-593c4bba-153e-44cc-8f1a-a7ca51b347e3 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.328295 Sep 08 13:53:15.225529 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 45/100] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:14 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:15.252118 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-eb9f4387-99cd-40af-93c4-d44e261f772b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:15.262430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb9f4387-99cd-40af-93c4-d44e261f772b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.329796 Sep 08 13:53:15.263945 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 56/101] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:14 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:15.829242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ffb4d1f7-89e5-4ed4-b1dc-b768b22b0fe6 req-b95c09cd-2504-479b-aca7-72af0a745f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a4b8e4-4292-4db0-89b6-b09f84f513ce", "name": "network-vif-plugged", "status": "completed", "tag": "94671fa2-8c0f-46c1-8d8a-12ec57a1598d"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:15.846196 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ffb4d1f7-89e5-4ed4-b1dc-b768b22b0fe6 req-b95c09cd-2504-479b-aca7-72af0a745f07 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:15.847279 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ffb4d1f7-89e5-4ed4-b1dc-b768b22b0fe6 req-b95c09cd-2504-479b-aca7-72af0a745f07 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:15.848386 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ffb4d1f7-89e5-4ed4-b1dc-b768b22b0fe6 req-b95c09cd-2504-479b-aca7-72af0a745f07 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:15.868116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ffb4d1f7-89e5-4ed4-b1dc-b768b22b0fe6 req-b95c09cd-2504-479b-aca7-72af0a745f07 service nova] Creating event network-vif-plugged:94671fa2-8c0f-46c1-8d8a-12ec57a1598d for instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce on hv-cinder-82002 Sep 08 13:53:15.874419 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0f064ed9-6621-4a9e-877d-acae426890fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:15.874975 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ffb4d1f7-89e5-4ed4-b1dc-b768b22b0fe6 req-b95c09cd-2504-479b-aca7-72af0a745f07 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256260 Sep 08 13:53:15.876373 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0f064ed9-6621-4a9e-877d-acae426890fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:15.881791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 46/102] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:15.893850 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f064ed9-6621-4a9e-877d-acae426890fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:15.894371 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f064ed9-6621-4a9e-877d-acae426890fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:15.894812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f064ed9-6621-4a9e-877d-acae426890fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:15.895554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f064ed9-6621-4a9e-877d-acae426890fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:15.896871 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f064ed9-6621-4a9e-877d-acae426890fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:15.897515 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f064ed9-6621-4a9e-877d-acae426890fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:15.958116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-94f5021a-7d5f-442b-b5ae-d40fa0e06dd5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:15.958840 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-94f5021a-7d5f-442b-b5ae-d40fa0e06dd5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:15.972916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94f5021a-7d5f-442b-b5ae-d40fa0e06dd5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:15.973709 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94f5021a-7d5f-442b-b5ae-d40fa0e06dd5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:15.974455 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94f5021a-7d5f-442b-b5ae-d40fa0e06dd5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:15.975383 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94f5021a-7d5f-442b-b5ae-d40fa0e06dd5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:15.976051 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94f5021a-7d5f-442b-b5ae-d40fa0e06dd5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:15.976755 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94f5021a-7d5f-442b-b5ae-d40fa0e06dd5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:16.554135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0f064ed9-6621-4a9e-877d-acae426890fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:16.566753 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0f064ed9-6621-4a9e-877d-acae426890fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.704285 Sep 08 13:53:16.578780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 57/103] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:15 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:16.580086 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-748efdc4-4592-4905-a4af-d5211c66ada7 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:16.580966 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-748efdc4-4592-4905-a4af-d5211c66ada7 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:16.603705 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-748efdc4-4592-4905-a4af-d5211c66ada7 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:16.607826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-748efdc4-4592-4905-a4af-d5211c66ada7 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:16.611993 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-748efdc4-4592-4905-a4af-d5211c66ada7 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:16.613019 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-748efdc4-4592-4905-a4af-d5211c66ada7 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:16.615957 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-748efdc4-4592-4905-a4af-d5211c66ada7 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:16.616407 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-748efdc4-4592-4905-a4af-d5211c66ada7 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:16.633275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-94f5021a-7d5f-442b-b5ae-d40fa0e06dd5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:16.646181 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-94f5021a-7d5f-442b-b5ae-d40fa0e06dd5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.696278 Sep 08 13:53:16.647564 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 47/104] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:15 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:16.664214 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cb62f560-41ef-499e-9f84-716467add3bc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:16.665262 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cb62f560-41ef-499e-9f84-716467add3bc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:16.682481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb62f560-41ef-499e-9f84-716467add3bc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:16.683175 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb62f560-41ef-499e-9f84-716467add3bc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:16.683899 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb62f560-41ef-499e-9f84-716467add3bc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:16.685181 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb62f560-41ef-499e-9f84-716467add3bc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:16.686205 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb62f560-41ef-499e-9f84-716467add3bc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:16.686827 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cb62f560-41ef-499e-9f84-716467add3bc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:16.942557 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cb62f560-41ef-499e-9f84-716467add3bc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:16.950232 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cb62f560-41ef-499e-9f84-716467add3bc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.300456 Sep 08 13:53:16.950891 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 48/105] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:16 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:16.965567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-748efdc4-4592-4905-a4af-d5211c66ada7 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:16.980034 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-748efdc4-4592-4905-a4af-d5211c66ada7 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.408425 Sep 08 13:53:16.980885 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 58/106] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:16 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:17.592724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7e56c54c-b1ae-496f-9147-e852146965d1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:17.593651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7e56c54c-b1ae-496f-9147-e852146965d1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:17.600020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e56c54c-b1ae-496f-9147-e852146965d1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:17.600508 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e56c54c-b1ae-496f-9147-e852146965d1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:17.600922 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e56c54c-b1ae-496f-9147-e852146965d1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:17.601981 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e56c54c-b1ae-496f-9147-e852146965d1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:17.602580 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e56c54c-b1ae-496f-9147-e852146965d1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:17.603144 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7e56c54c-b1ae-496f-9147-e852146965d1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:17.675676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-afac51f8-46dc-4fd5-aa73-3ed5a9101e80 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:17.676282 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-afac51f8-46dc-4fd5-aa73-3ed5a9101e80 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:17.683797 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afac51f8-46dc-4fd5-aa73-3ed5a9101e80 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:17.684550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afac51f8-46dc-4fd5-aa73-3ed5a9101e80 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:17.685158 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afac51f8-46dc-4fd5-aa73-3ed5a9101e80 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:17.686034 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afac51f8-46dc-4fd5-aa73-3ed5a9101e80 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:17.687151 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afac51f8-46dc-4fd5-aa73-3ed5a9101e80 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:17.687693 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afac51f8-46dc-4fd5-aa73-3ed5a9101e80 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:17.879710 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7e56c54c-b1ae-496f-9147-e852146965d1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:17.889221 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7e56c54c-b1ae-496f-9147-e852146965d1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.300313 Sep 08 13:53:17.890704 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 49/107] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:17 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:17.909306 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-56c15e82-1a29-4c65-93c7-0dddb2afc7d0 req-08911a04-bf12-4aee-bc5d-92d64613b398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a4e6c3b-d230-477f-b406-5f55ec596b1e", "name": "network-vif-plugged", "status": "completed", "tag": "2e9cdac8-d126-4ec3-8459-aaf58c0148d7"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:17.920931 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56c15e82-1a29-4c65-93c7-0dddb2afc7d0 req-08911a04-bf12-4aee-bc5d-92d64613b398 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:17.921575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-afac51f8-46dc-4fd5-aa73-3ed5a9101e80 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:17.922351 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56c15e82-1a29-4c65-93c7-0dddb2afc7d0 req-08911a04-bf12-4aee-bc5d-92d64613b398 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:17.923582 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-56c15e82-1a29-4c65-93c7-0dddb2afc7d0 req-08911a04-bf12-4aee-bc5d-92d64613b398 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:17.929710 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-afac51f8-46dc-4fd5-aa73-3ed5a9101e80 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.257802 Sep 08 13:53:17.932993 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 59/108] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:17 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:17.936944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-56c15e82-1a29-4c65-93c7-0dddb2afc7d0 req-08911a04-bf12-4aee-bc5d-92d64613b398 service nova] Creating event network-vif-plugged:2e9cdac8-d126-4ec3-8459-aaf58c0148d7 for instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e on hv-cinder-82002 Sep 08 13:53:17.942707 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-56c15e82-1a29-4c65-93c7-0dddb2afc7d0 req-08911a04-bf12-4aee-bc5d-92d64613b398 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039084 Sep 08 13:53:17.943983 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 50/109] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:53:17.979392 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cf56e6b5-4d89-45b8-8147-30992364a107 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:17.981172 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cf56e6b5-4d89-45b8-8147-30992364a107 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:17.990825 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf56e6b5-4d89-45b8-8147-30992364a107 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:17.991800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf56e6b5-4d89-45b8-8147-30992364a107 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:17.992566 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf56e6b5-4d89-45b8-8147-30992364a107 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:17.993470 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf56e6b5-4d89-45b8-8147-30992364a107 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:17.994265 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf56e6b5-4d89-45b8-8147-30992364a107 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:17.995066 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf56e6b5-4d89-45b8-8147-30992364a107 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:18.003551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-acf090b4-1cb3-4f7c-bfae-2fe5866f74a9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:18.004335 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-acf090b4-1cb3-4f7c-bfae-2fe5866f74a9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:18.015570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acf090b4-1cb3-4f7c-bfae-2fe5866f74a9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:18.017062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acf090b4-1cb3-4f7c-bfae-2fe5866f74a9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:18.017685 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acf090b4-1cb3-4f7c-bfae-2fe5866f74a9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:18.019001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acf090b4-1cb3-4f7c-bfae-2fe5866f74a9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:18.019868 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acf090b4-1cb3-4f7c-bfae-2fe5866f74a9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:18.020773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-acf090b4-1cb3-4f7c-bfae-2fe5866f74a9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:18.260015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-cf56e6b5-4d89-45b8-8147-30992364a107 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:18.268064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cf56e6b5-4d89-45b8-8147-30992364a107 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.294680 Sep 08 13:53:18.287456 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 60/110] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:17 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:18.294697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-acf090b4-1cb3-4f7c-bfae-2fe5866f74a9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:18.303957 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-acf090b4-1cb3-4f7c-bfae-2fe5866f74a9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.305099 Sep 08 13:53:18.304586 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 51/111] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:17 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:18.914901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-118e1da3-121d-46da-aea8-9f7bfb9c2220 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:18.916562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-118e1da3-121d-46da-aea8-9f7bfb9c2220 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:18.927862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-118e1da3-121d-46da-aea8-9f7bfb9c2220 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:18.928362 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-118e1da3-121d-46da-aea8-9f7bfb9c2220 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:18.930714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-118e1da3-121d-46da-aea8-9f7bfb9c2220 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:18.933555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-118e1da3-121d-46da-aea8-9f7bfb9c2220 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:18.934188 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-118e1da3-121d-46da-aea8-9f7bfb9c2220 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:18.937267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-118e1da3-121d-46da-aea8-9f7bfb9c2220 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:18.957048 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-53e3a80e-9a1c-4304-ac9b-33a0c9243aa4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:18.958623 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-53e3a80e-9a1c-4304-ac9b-33a0c9243aa4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:18.969371 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e3a80e-9a1c-4304-ac9b-33a0c9243aa4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:18.973244 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e3a80e-9a1c-4304-ac9b-33a0c9243aa4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:18.975429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e3a80e-9a1c-4304-ac9b-33a0c9243aa4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:18.979875 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e3a80e-9a1c-4304-ac9b-33a0c9243aa4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:18.981681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e3a80e-9a1c-4304-ac9b-33a0c9243aa4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:18.984886 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-53e3a80e-9a1c-4304-ac9b-33a0c9243aa4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:19.281516 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-118e1da3-121d-46da-aea8-9f7bfb9c2220 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:19.297289 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-118e1da3-121d-46da-aea8-9f7bfb9c2220 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.387287 Sep 08 13:53:19.298212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 61/112] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:18 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:19.307364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b7fdb474-a8b9-4d98-a339-44fbcc4ec403 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:19.308571 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b7fdb474-a8b9-4d98-a339-44fbcc4ec403 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:19.321468 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fdb474-a8b9-4d98-a339-44fbcc4ec403 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:19.327845 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fdb474-a8b9-4d98-a339-44fbcc4ec403 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:19.328566 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fdb474-a8b9-4d98-a339-44fbcc4ec403 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:19.329514 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fdb474-a8b9-4d98-a339-44fbcc4ec403 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:19.330240 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fdb474-a8b9-4d98-a339-44fbcc4ec403 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:19.330907 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b7fdb474-a8b9-4d98-a339-44fbcc4ec403 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:19.336659 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:19.386527 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-53e3a80e-9a1c-4304-ac9b-33a0c9243aa4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:19.397301 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-53e3a80e-9a1c-4304-ac9b-33a0c9243aa4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.445521 Sep 08 13:53:19.411472 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 52/113] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:18 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:19.423237 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d4972e4f-2c4e-4b08-be53-e41059c8c5db tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:19.425441 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d4972e4f-2c4e-4b08-be53-e41059c8c5db tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:19.432317 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4972e4f-2c4e-4b08-be53-e41059c8c5db tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:19.433198 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4972e4f-2c4e-4b08-be53-e41059c8c5db tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:19.433890 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4972e4f-2c4e-4b08-be53-e41059c8c5db tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:19.434988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4972e4f-2c4e-4b08-be53-e41059c8c5db tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:19.435692 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4972e4f-2c4e-4b08-be53-e41059c8c5db tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:19.436372 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d4972e4f-2c4e-4b08-be53-e41059c8c5db tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:19.971803 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b7fdb474-a8b9-4d98-a339-44fbcc4ec403 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:19.983666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b7fdb474-a8b9-4d98-a339-44fbcc4ec403 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.684166 Sep 08 13:53:19.984311 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 62/114] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:19 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:20.021725 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d4972e4f-2c4e-4b08-be53-e41059c8c5db tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:20.033973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d4972e4f-2c4e-4b08-be53-e41059c8c5db tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.620996 Sep 08 13:53:20.035011 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 53/115] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:19 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:20.327473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3d8b249e-bbcf-4cf2-8467-c43d5347ca22 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:20.328407 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3d8b249e-bbcf-4cf2-8467-c43d5347ca22 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:20.335084 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d8b249e-bbcf-4cf2-8467-c43d5347ca22 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:20.336364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d8b249e-bbcf-4cf2-8467-c43d5347ca22 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:20.337491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d8b249e-bbcf-4cf2-8467-c43d5347ca22 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:20.338570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d8b249e-bbcf-4cf2-8467-c43d5347ca22 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:20.339084 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d8b249e-bbcf-4cf2-8467-c43d5347ca22 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:20.339567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3d8b249e-bbcf-4cf2-8467-c43d5347ca22 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:20.429895 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c2d71569-5215-4ac3-a763-654593e0b5e0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:20.430969 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c2d71569-5215-4ac3-a763-654593e0b5e0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:20.457773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d71569-5215-4ac3-a763-654593e0b5e0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:20.460700 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d71569-5215-4ac3-a763-654593e0b5e0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:20.461488 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d71569-5215-4ac3-a763-654593e0b5e0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:20.464829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d71569-5215-4ac3-a763-654593e0b5e0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:20.465395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d71569-5215-4ac3-a763-654593e0b5e0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:20.467244 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d71569-5215-4ac3-a763-654593e0b5e0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:20.485697 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3d8b249e-bbcf-4cf2-8467-c43d5347ca22 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:20.496699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3d8b249e-bbcf-4cf2-8467-c43d5347ca22 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.174443 Sep 08 13:53:20.498243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 63/116] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:20 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:20.688618 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2d71569-5215-4ac3-a763-654593e0b5e0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:20.699160 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c2d71569-5215-4ac3-a763-654593e0b5e0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.276223 Sep 08 13:53:20.700076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 54/117] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:20 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:21.010498 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-36d2a843-235b-4b8d-ad41-91ea5697f06f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:21.011479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-36d2a843-235b-4b8d-ad41-91ea5697f06f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:21.020066 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36d2a843-235b-4b8d-ad41-91ea5697f06f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:21.021318 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36d2a843-235b-4b8d-ad41-91ea5697f06f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:21.022099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36d2a843-235b-4b8d-ad41-91ea5697f06f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:21.023196 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36d2a843-235b-4b8d-ad41-91ea5697f06f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:21.023835 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36d2a843-235b-4b8d-ad41-91ea5697f06f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:21.024484 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36d2a843-235b-4b8d-ad41-91ea5697f06f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:21.056644 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-02dff0dd-685b-4bf7-b8eb-ae13136e6285 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:21.057363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-02dff0dd-685b-4bf7-b8eb-ae13136e6285 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:21.065982 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02dff0dd-685b-4bf7-b8eb-ae13136e6285 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:21.066552 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02dff0dd-685b-4bf7-b8eb-ae13136e6285 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:21.066995 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02dff0dd-685b-4bf7-b8eb-ae13136e6285 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:21.067696 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02dff0dd-685b-4bf7-b8eb-ae13136e6285 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:21.068149 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02dff0dd-685b-4bf7-b8eb-ae13136e6285 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:21.068566 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-02dff0dd-685b-4bf7-b8eb-ae13136e6285 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:21.293659 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-36d2a843-235b-4b8d-ad41-91ea5697f06f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:21.295050 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-02dff0dd-685b-4bf7-b8eb-ae13136e6285 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:21.303002 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-02dff0dd-685b-4bf7-b8eb-ae13136e6285 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.250236 Sep 08 13:53:21.303895 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 55/118] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:21 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:21.305082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-36d2a843-235b-4b8d-ad41-91ea5697f06f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.300037 Sep 08 13:53:21.305951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 64/119] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:21 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:21.528305 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-045cbdb4-d637-4b50-855b-1ef03c4730a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:21.528803 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-045cbdb4-d637-4b50-855b-1ef03c4730a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:21.535324 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045cbdb4-d637-4b50-855b-1ef03c4730a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:21.535864 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045cbdb4-d637-4b50-855b-1ef03c4730a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:21.536295 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045cbdb4-d637-4b50-855b-1ef03c4730a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:21.537047 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045cbdb4-d637-4b50-855b-1ef03c4730a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:21.537489 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045cbdb4-d637-4b50-855b-1ef03c4730a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:21.538114 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-045cbdb4-d637-4b50-855b-1ef03c4730a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:21.557992 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:21.707189 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-045cbdb4-d637-4b50-855b-1ef03c4730a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:21.717536 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-045cbdb4-d637-4b50-855b-1ef03c4730a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.200386 Sep 08 13:53:21.723279 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7dd1d134-361e-456b-8051-f74a0af5cb47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:21.724049 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7dd1d134-361e-456b-8051-f74a0af5cb47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:21.730462 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 56/120] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:21 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:21.732086 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd1d134-361e-456b-8051-f74a0af5cb47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:21.732829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd1d134-361e-456b-8051-f74a0af5cb47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:21.733689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd1d134-361e-456b-8051-f74a0af5cb47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:21.734594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd1d134-361e-456b-8051-f74a0af5cb47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:21.735374 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd1d134-361e-456b-8051-f74a0af5cb47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:21.735979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7dd1d134-361e-456b-8051-f74a0af5cb47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:21.899953 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7dd1d134-361e-456b-8051-f74a0af5cb47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:21.915729 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7dd1d134-361e-456b-8051-f74a0af5cb47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.195753 Sep 08 13:53:21.916490 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 65/121] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:21 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:22.334874 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e7944a0b-a269-47e2-9faf-9c246f67d631 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:22.335621 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e7944a0b-a269-47e2-9faf-9c246f67d631 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:22.337215 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd131ec2-2121-4b18-8b2a-78a4ca202680 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:22.338170 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fd131ec2-2121-4b18-8b2a-78a4ca202680 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:22.342061 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7944a0b-a269-47e2-9faf-9c246f67d631 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:22.342801 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7944a0b-a269-47e2-9faf-9c246f67d631 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:22.344007 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7944a0b-a269-47e2-9faf-9c246f67d631 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:22.344944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7944a0b-a269-47e2-9faf-9c246f67d631 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:22.345577 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd131ec2-2121-4b18-8b2a-78a4ca202680 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:22.345725 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7944a0b-a269-47e2-9faf-9c246f67d631 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:22.346135 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e7944a0b-a269-47e2-9faf-9c246f67d631 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:22.346537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd131ec2-2121-4b18-8b2a-78a4ca202680 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:22.347137 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd131ec2-2121-4b18-8b2a-78a4ca202680 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:22.348173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd131ec2-2121-4b18-8b2a-78a4ca202680 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:22.348959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd131ec2-2121-4b18-8b2a-78a4ca202680 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:22.349531 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd131ec2-2121-4b18-8b2a-78a4ca202680 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:22.568436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-fd131ec2-2121-4b18-8b2a-78a4ca202680 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:22.573102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e7944a0b-a269-47e2-9faf-9c246f67d631 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:22.581074 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd131ec2-2121-4b18-8b2a-78a4ca202680 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.247370 Sep 08 13:53:22.583630 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e7944a0b-a269-47e2-9faf-9c246f67d631 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.252579 Sep 08 13:53:22.584400 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 66/122] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:22 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:22.584854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 57/123] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:22 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:22.753058 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-34a05a84-67c6-422a-8061-a9ac39379a81 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:22.754326 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-34a05a84-67c6-422a-8061-a9ac39379a81 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:22.762978 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a05a84-67c6-422a-8061-a9ac39379a81 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:22.764513 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a05a84-67c6-422a-8061-a9ac39379a81 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:22.765253 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a05a84-67c6-422a-8061-a9ac39379a81 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:22.768029 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a05a84-67c6-422a-8061-a9ac39379a81 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:22.769352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a05a84-67c6-422a-8061-a9ac39379a81 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:22.786638 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34a05a84-67c6-422a-8061-a9ac39379a81 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:22.939694 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-62c29495-0d5a-4c80-86f5-9d47b4220343 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:22.940307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-62c29495-0d5a-4c80-86f5-9d47b4220343 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:22.948227 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c29495-0d5a-4c80-86f5-9d47b4220343 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:22.948930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c29495-0d5a-4c80-86f5-9d47b4220343 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:22.950599 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c29495-0d5a-4c80-86f5-9d47b4220343 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:22.951466 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c29495-0d5a-4c80-86f5-9d47b4220343 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:22.952742 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c29495-0d5a-4c80-86f5-9d47b4220343 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:22.953598 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62c29495-0d5a-4c80-86f5-9d47b4220343 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:22.966742 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-34a05a84-67c6-422a-8061-a9ac39379a81 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:22.978218 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-34a05a84-67c6-422a-8061-a9ac39379a81 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1368 microversion: 2.1 time: 0.229514 Sep 08 13:53:22.990372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 67/124] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:22 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:23.112852 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-62c29495-0d5a-4c80-86f5-9d47b4220343 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:23.124077 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-62c29495-0d5a-4c80-86f5-9d47b4220343 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.188546 Sep 08 13:53:23.125635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 58/125] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:22 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:23.607689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0373fecf-72ae-4ef5-a853-9634981fa0b0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:23.607923 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9d82600-2a38-44b8-897c-6c5c6fb0f9c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:23.608579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9d82600-2a38-44b8-897c-6c5c6fb0f9c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:23.609586 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0373fecf-72ae-4ef5-a853-9634981fa0b0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:23.617348 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d82600-2a38-44b8-897c-6c5c6fb0f9c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:23.618935 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d82600-2a38-44b8-897c-6c5c6fb0f9c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:23.619736 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d82600-2a38-44b8-897c-6c5c6fb0f9c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:23.621700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0373fecf-72ae-4ef5-a853-9634981fa0b0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:23.622309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0373fecf-72ae-4ef5-a853-9634981fa0b0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:23.623399 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d82600-2a38-44b8-897c-6c5c6fb0f9c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:23.624007 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0373fecf-72ae-4ef5-a853-9634981fa0b0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:23.624139 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d82600-2a38-44b8-897c-6c5c6fb0f9c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:23.625334 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0373fecf-72ae-4ef5-a853-9634981fa0b0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:23.625718 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9d82600-2a38-44b8-897c-6c5c6fb0f9c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:23.626030 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0373fecf-72ae-4ef5-a853-9634981fa0b0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:23.626658 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0373fecf-72ae-4ef5-a853-9634981fa0b0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:23.882600 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0373fecf-72ae-4ef5-a853-9634981fa0b0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:23.893179 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0373fecf-72ae-4ef5-a853-9634981fa0b0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.290447 Sep 08 13:53:23.896155 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 68/126] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:23 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:23.913529 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9d82600-2a38-44b8-897c-6c5c6fb0f9c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:23.922410 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9d82600-2a38-44b8-897c-6c5c6fb0f9c9 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1314 microversion: 2.1 time: 0.318157 Sep 08 13:53:23.923457 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 59/127] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:23 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:24.006366 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d7f14aa7-c230-44c3-8dde-d71e5ea5d27d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:24.007087 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d7f14aa7-c230-44c3-8dde-d71e5ea5d27d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:24.018782 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f14aa7-c230-44c3-8dde-d71e5ea5d27d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:24.020718 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f14aa7-c230-44c3-8dde-d71e5ea5d27d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:24.022334 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f14aa7-c230-44c3-8dde-d71e5ea5d27d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:24.030822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f14aa7-c230-44c3-8dde-d71e5ea5d27d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:24.033343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f14aa7-c230-44c3-8dde-d71e5ea5d27d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:24.034443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7f14aa7-c230-44c3-8dde-d71e5ea5d27d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:24.150409 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bd35baf2-fa82-407f-a11e-432d1c84e14d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:24.151113 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bd35baf2-fa82-407f-a11e-432d1c84e14d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:24.159451 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd35baf2-fa82-407f-a11e-432d1c84e14d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:24.160365 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd35baf2-fa82-407f-a11e-432d1c84e14d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:24.164785 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd35baf2-fa82-407f-a11e-432d1c84e14d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:24.165719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd35baf2-fa82-407f-a11e-432d1c84e14d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:24.166357 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd35baf2-fa82-407f-a11e-432d1c84e14d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:24.169494 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bd35baf2-fa82-407f-a11e-432d1c84e14d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:24.343187 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d7f14aa7-c230-44c3-8dde-d71e5ea5d27d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:24.358507 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d7f14aa7-c230-44c3-8dde-d71e5ea5d27d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1558 microversion: 2.1 time: 0.360529 Sep 08 13:53:24.375010 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 69/128] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:23 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1558 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:24.389091 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ec5d56f-fd6d-4a6f-bf23-4fa21738591d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:24.390847 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ec5d56f-fd6d-4a6f-bf23-4fa21738591d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:24.400390 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec5d56f-fd6d-4a6f-bf23-4fa21738591d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:24.401192 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec5d56f-fd6d-4a6f-bf23-4fa21738591d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:24.401910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec5d56f-fd6d-4a6f-bf23-4fa21738591d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:24.402824 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec5d56f-fd6d-4a6f-bf23-4fa21738591d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:24.404866 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec5d56f-fd6d-4a6f-bf23-4fa21738591d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:24.407391 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ec5d56f-fd6d-4a6f-bf23-4fa21738591d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:24.509217 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-bd35baf2-fa82-407f-a11e-432d1c84e14d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:24.517440 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bd35baf2-fa82-407f-a11e-432d1c84e14d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.370941 Sep 08 13:53:24.523300 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 60/129] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:24 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:24.595374 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ec5d56f-fd6d-4a6f-bf23-4fa21738591d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215039 Sep 08 13:53:24.604104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 70/130] 10.222.0.55 () {58 vars in 1275 bytes} [Thu Sep 8 13:53:24 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:53:24.920748 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-63bfe1ef-9def-447b-a7cb-99e096cb6ac8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:24.921458 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-63bfe1ef-9def-447b-a7cb-99e096cb6ac8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:24.928164 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63bfe1ef-9def-447b-a7cb-99e096cb6ac8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:24.928950 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63bfe1ef-9def-447b-a7cb-99e096cb6ac8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:24.929610 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63bfe1ef-9def-447b-a7cb-99e096cb6ac8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:24.930733 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63bfe1ef-9def-447b-a7cb-99e096cb6ac8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:24.931400 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63bfe1ef-9def-447b-a7cb-99e096cb6ac8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:24.931896 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63bfe1ef-9def-447b-a7cb-99e096cb6ac8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:24.949657 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33a16f53-c34f-4e0f-925e-de1a22e61c07 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:24.951054 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33a16f53-c34f-4e0f-925e-de1a22e61c07 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:24.966679 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33a16f53-c34f-4e0f-925e-de1a22e61c07 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:24.969247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33a16f53-c34f-4e0f-925e-de1a22e61c07 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:24.970103 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33a16f53-c34f-4e0f-925e-de1a22e61c07 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:24.974428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33a16f53-c34f-4e0f-925e-de1a22e61c07 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:24.975161 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33a16f53-c34f-4e0f-925e-de1a22e61c07 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:24.975786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33a16f53-c34f-4e0f-925e-de1a22e61c07 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:25.297207 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-63bfe1ef-9def-447b-a7cb-99e096cb6ac8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:25.306990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-63bfe1ef-9def-447b-a7cb-99e096cb6ac8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.390373 Sep 08 13:53:25.307816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 61/131] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:24 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:25.313622 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-255143b1-e522-4a6a-8e17-87b215a0d692 req-7d09f47b-23c8-4750-b5d0-11e6f89ece26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17665f83-a581-4f16-9275-45bce05f5f49", "name": "network-vif-plugged", "status": "completed", "tag": "5c7e423f-8bb5-4a1a-a739-7918f898d812"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:25.324690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-255143b1-e522-4a6a-8e17-87b215a0d692 req-7d09f47b-23c8-4750-b5d0-11e6f89ece26 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:25.325523 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-255143b1-e522-4a6a-8e17-87b215a0d692 req-7d09f47b-23c8-4750-b5d0-11e6f89ece26 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:25.326831 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-255143b1-e522-4a6a-8e17-87b215a0d692 req-7d09f47b-23c8-4750-b5d0-11e6f89ece26 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:25.371975 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-255143b1-e522-4a6a-8e17-87b215a0d692 req-7d09f47b-23c8-4750-b5d0-11e6f89ece26 service nova] Creating event network-vif-plugged:5c7e423f-8bb5-4a1a-a739-7918f898d812 for instance 17665f83-a581-4f16-9275-45bce05f5f49 on hv-cinder-82002 Sep 08 13:53:25.379083 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-255143b1-e522-4a6a-8e17-87b215a0d692 req-7d09f47b-23c8-4750-b5d0-11e6f89ece26 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069738 Sep 08 13:53:25.380525 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 62/132] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:25.404249 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-33a16f53-c34f-4e0f-925e-de1a22e61c07 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:25.414584 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33a16f53-c34f-4e0f-925e-de1a22e61c07 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1499 microversion: 2.1 time: 0.468629 Sep 08 13:53:25.417202 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 71/133] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:24 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1499 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:25.552278 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37de43ed-026e-462a-a678-4e4f5734bb21 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:25.553396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37de43ed-026e-462a-a678-4e4f5734bb21 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:25.576244 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37de43ed-026e-462a-a678-4e4f5734bb21 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:25.577654 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37de43ed-026e-462a-a678-4e4f5734bb21 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:25.579506 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37de43ed-026e-462a-a678-4e4f5734bb21 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:25.580504 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37de43ed-026e-462a-a678-4e4f5734bb21 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:25.581669 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37de43ed-026e-462a-a678-4e4f5734bb21 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:25.582712 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37de43ed-026e-462a-a678-4e4f5734bb21 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:25.812769 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-37de43ed-026e-462a-a678-4e4f5734bb21 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:25.824748 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37de43ed-026e-462a-a678-4e4f5734bb21 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.278066 Sep 08 13:53:25.826863 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 63/134] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:25 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:26.333491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e3923d01-d046-4298-9e71-406e4332d92c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:26.333491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e3923d01-d046-4298-9e71-406e4332d92c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:26.337905 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3923d01-d046-4298-9e71-406e4332d92c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:26.338384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3923d01-d046-4298-9e71-406e4332d92c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:26.338809 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3923d01-d046-4298-9e71-406e4332d92c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:26.339492 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3923d01-d046-4298-9e71-406e4332d92c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:26.339935 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3923d01-d046-4298-9e71-406e4332d92c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:26.340348 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3923d01-d046-4298-9e71-406e4332d92c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:26.500112 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-89c624f0-1b0f-48f9-8614-295cbf8679d3 req-1608039c-73ed-498c-a0cb-01cf9aba91a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a4b8e4-4292-4db0-89b6-b09f84f513ce", "tag": "94671fa2-8c0f-46c1-8d8a-12ec57a1598d"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:26.524304 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-89c624f0-1b0f-48f9-8614-295cbf8679d3 req-1608039c-73ed-498c-a0cb-01cf9aba91a7 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:26.524786 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-89c624f0-1b0f-48f9-8614-295cbf8679d3 req-1608039c-73ed-498c-a0cb-01cf9aba91a7 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:26.525210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-89c624f0-1b0f-48f9-8614-295cbf8679d3 req-1608039c-73ed-498c-a0cb-01cf9aba91a7 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:26.547672 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e3923d01-d046-4298-9e71-406e4332d92c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:26.553916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-89c624f0-1b0f-48f9-8614-295cbf8679d3 req-1608039c-73ed-498c-a0cb-01cf9aba91a7 service nova] Creating event network-changed:94671fa2-8c0f-46c1-8d8a-12ec57a1598d for instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce on hv-cinder-82002 Sep 08 13:53:26.559248 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e3923d01-d046-4298-9e71-406e4332d92c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.232597 Sep 08 13:53:26.559392 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-89c624f0-1b0f-48f9-8614-295cbf8679d3 req-1608039c-73ed-498c-a0cb-01cf9aba91a7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062815 Sep 08 13:53:26.559960 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 64/135] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:53:26.560427 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 72/136] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:26 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:26.849665 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24ab8ea8-6d01-4722-ab49-739520a3e852 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:26.850767 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-24ab8ea8-6d01-4722-ab49-739520a3e852 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:26.857434 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ab8ea8-6d01-4722-ab49-739520a3e852 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:26.858107 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ab8ea8-6d01-4722-ab49-739520a3e852 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:26.858602 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ab8ea8-6d01-4722-ab49-739520a3e852 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:26.859367 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ab8ea8-6d01-4722-ab49-739520a3e852 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:26.860627 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ab8ea8-6d01-4722-ab49-739520a3e852 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:26.861055 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24ab8ea8-6d01-4722-ab49-739520a3e852 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:27.064617 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-24ab8ea8-6d01-4722-ab49-739520a3e852 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:27.075772 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-24ab8ea8-6d01-4722-ab49-739520a3e852 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.229371 Sep 08 13:53:27.077558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 65/137] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:26 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:27.218586 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b62d844-dbc7-448b-83f5-7352f9d0cfd2 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "625a8894-8bfd-466d-b4d1-136e9b47f8a0"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:27.221133 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b62d844-dbc7-448b-83f5-7352f9d0cfd2 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:27.227408 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b62d844-dbc7-448b-83f5-7352f9d0cfd2 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:27.227946 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b62d844-dbc7-448b-83f5-7352f9d0cfd2 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:27.228321 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b62d844-dbc7-448b-83f5-7352f9d0cfd2 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:27.229051 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b62d844-dbc7-448b-83f5-7352f9d0cfd2 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:27.229556 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b62d844-dbc7-448b-83f5-7352f9d0cfd2 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:27.230001 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b62d844-dbc7-448b-83f5-7352f9d0cfd2 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:27.450462 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-341f0f7b-153b-4565-9225-4c265a07cef7 req-18ef514a-0aaa-4463-80d4-6c6a9a37cb0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c", "name": "network-vif-plugged", "status": "completed", "tag": "8264f39d-725c-426b-913c-05ab5ad2087e"}, {"server_uuid": "d2ad7906-3b73-4fc9-a692-9692fb6234b3", "name": "network-vif-plugged", "status": "completed", "tag": "86699af9-4b49-40e3-b189-ff4a7a9e5e59"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:27.462718 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-341f0f7b-153b-4565-9225-4c265a07cef7 req-18ef514a-0aaa-4463-80d4-6c6a9a37cb0d service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:27.463235 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-341f0f7b-153b-4565-9225-4c265a07cef7 req-18ef514a-0aaa-4463-80d4-6c6a9a37cb0d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:27.463709 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-341f0f7b-153b-4565-9225-4c265a07cef7 req-18ef514a-0aaa-4463-80d4-6c6a9a37cb0d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:27.478449 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-341f0f7b-153b-4565-9225-4c265a07cef7 req-18ef514a-0aaa-4463-80d4-6c6a9a37cb0d service nova] Creating event network-vif-plugged:8264f39d-725c-426b-913c-05ab5ad2087e for instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c on hv-cinder-82002 Sep 08 13:53:27.478961 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-341f0f7b-153b-4565-9225-4c265a07cef7 req-18ef514a-0aaa-4463-80d4-6c6a9a37cb0d service nova] Creating event network-vif-plugged:86699af9-4b49-40e3-b189-ff4a7a9e5e59 for instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 on hv-cinder-82002 Sep 08 13:53:27.486112 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-341f0f7b-153b-4565-9225-4c265a07cef7 req-18ef514a-0aaa-4463-80d4-6c6a9a37cb0d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040098 Sep 08 13:53:27.486745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 66/138] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:27.582969 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52e02d01-7f0e-46a0-a795-53e2d5c2611f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:27.583671 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-52e02d01-7f0e-46a0-a795-53e2d5c2611f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:27.590405 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52e02d01-7f0e-46a0-a795-53e2d5c2611f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:27.590890 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52e02d01-7f0e-46a0-a795-53e2d5c2611f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:27.591321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52e02d01-7f0e-46a0-a795-53e2d5c2611f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:27.592019 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52e02d01-7f0e-46a0-a795-53e2d5c2611f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:27.593157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52e02d01-7f0e-46a0-a795-53e2d5c2611f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:27.593477 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52e02d01-7f0e-46a0-a795-53e2d5c2611f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:27.772441 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-52e02d01-7f0e-46a0-a795-53e2d5c2611f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:27.781228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-52e02d01-7f0e-46a0-a795-53e2d5c2611f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1321 microversion: 2.1 time: 0.202332 Sep 08 13:53:27.795060 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 67/139] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:27 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:28.100827 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-81af8009-bf77-4ac0-af79-735269d8ebd1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:28.101676 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-81af8009-bf77-4ac0-af79-735269d8ebd1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:28.111092 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81af8009-bf77-4ac0-af79-735269d8ebd1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:28.111429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81af8009-bf77-4ac0-af79-735269d8ebd1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:28.111993 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81af8009-bf77-4ac0-af79-735269d8ebd1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:28.112781 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81af8009-bf77-4ac0-af79-735269d8ebd1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:28.113364 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81af8009-bf77-4ac0-af79-735269d8ebd1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:28.114058 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81af8009-bf77-4ac0-af79-735269d8ebd1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:28.485576 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b62d844-dbc7-448b-83f5-7352f9d0cfd2 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "POST /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.270453 Sep 08 13:53:28.486267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 73/140] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 13:53:27 2022] POST /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e/os-volume_attachments => generated 194 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:28.563256 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-81af8009-bf77-4ac0-af79-735269d8ebd1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:28.597775 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-81af8009-bf77-4ac0-af79-735269d8ebd1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.488820 Sep 08 13:53:28.597775 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 68/141] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:28 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:28.808450 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-78e3e720-2eb6-4b0d-b4ee-33e0de79abbb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:28.809479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-78e3e720-2eb6-4b0d-b4ee-33e0de79abbb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:28.818629 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e3e720-2eb6-4b0d-b4ee-33e0de79abbb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:28.819454 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e3e720-2eb6-4b0d-b4ee-33e0de79abbb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:28.820051 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e3e720-2eb6-4b0d-b4ee-33e0de79abbb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:28.828658 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e3e720-2eb6-4b0d-b4ee-33e0de79abbb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:28.829516 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e3e720-2eb6-4b0d-b4ee-33e0de79abbb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:28.830173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-78e3e720-2eb6-4b0d-b4ee-33e0de79abbb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:29.046690 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-78e3e720-2eb6-4b0d-b4ee-33e0de79abbb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:29.056864 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-78e3e720-2eb6-4b0d-b4ee-33e0de79abbb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1515 microversion: 2.1 time: 0.254638 Sep 08 13:53:29.073768 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 74/142] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:28 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:29.086520 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-69dfb2de-bf50-4d54-b4a3-1875fe81996b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:29.092066 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-69dfb2de-bf50-4d54-b4a3-1875fe81996b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:29.108806 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69dfb2de-bf50-4d54-b4a3-1875fe81996b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:29.109570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69dfb2de-bf50-4d54-b4a3-1875fe81996b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:29.111271 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69dfb2de-bf50-4d54-b4a3-1875fe81996b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:29.113359 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69dfb2de-bf50-4d54-b4a3-1875fe81996b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:29.113923 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69dfb2de-bf50-4d54-b4a3-1875fe81996b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:29.114485 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-69dfb2de-bf50-4d54-b4a3-1875fe81996b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:29.181720 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-69dfb2de-bf50-4d54-b4a3-1875fe81996b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lazy-loading 'flavor' on Instance uuid 17665f83-a581-4f16-9275-45bce05f5f49 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:53:29.309770 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-69dfb2de-bf50-4d54-b4a3-1875fe81996b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "POST /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49/action" status: 200 len: 32 microversion: 2.1 time: 0.229944 Sep 08 13:53:29.310522 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 69/143] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:53:29 2022] POST /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:53:29.320157 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-edc71bd9-2662-4ec4-a658-6f01a582417c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:29.321130 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-edc71bd9-2662-4ec4-a658-6f01a582417c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:29.327434 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc71bd9-2662-4ec4-a658-6f01a582417c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:29.327990 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc71bd9-2662-4ec4-a658-6f01a582417c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:29.328483 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc71bd9-2662-4ec4-a658-6f01a582417c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:29.329403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc71bd9-2662-4ec4-a658-6f01a582417c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:29.329979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc71bd9-2662-4ec4-a658-6f01a582417c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:29.330610 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-edc71bd9-2662-4ec4-a658-6f01a582417c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:29.526505 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-edc71bd9-2662-4ec4-a658-6f01a582417c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:29.538497 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-edc71bd9-2662-4ec4-a658-6f01a582417c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.222210 Sep 08 13:53:29.540029 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 75/144] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:29 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:29.616875 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3d30d1a-9cb6-4aee-b9df-0865516eaa59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:29.624412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3d30d1a-9cb6-4aee-b9df-0865516eaa59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:29.644611 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d30d1a-9cb6-4aee-b9df-0865516eaa59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:29.645594 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d30d1a-9cb6-4aee-b9df-0865516eaa59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:29.647347 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d30d1a-9cb6-4aee-b9df-0865516eaa59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:29.648855 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d30d1a-9cb6-4aee-b9df-0865516eaa59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:29.650445 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d30d1a-9cb6-4aee-b9df-0865516eaa59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:29.651217 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3d30d1a-9cb6-4aee-b9df-0865516eaa59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:29.852958 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3d30d1a-9cb6-4aee-b9df-0865516eaa59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:29.870192 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3d30d1a-9cb6-4aee-b9df-0865516eaa59 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.259953 Sep 08 13:53:29.870768 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 70/145] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:29 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:30.568283 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1dc9a8a7-a1a1-4cd9-88e8-6123946bf900 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:30.569661 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1dc9a8a7-a1a1-4cd9-88e8-6123946bf900 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:30.589660 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc9a8a7-a1a1-4cd9-88e8-6123946bf900 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:30.590364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc9a8a7-a1a1-4cd9-88e8-6123946bf900 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:30.590951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc9a8a7-a1a1-4cd9-88e8-6123946bf900 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:30.591849 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc9a8a7-a1a1-4cd9-88e8-6123946bf900 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:30.593115 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc9a8a7-a1a1-4cd9-88e8-6123946bf900 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:30.594259 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1dc9a8a7-a1a1-4cd9-88e8-6123946bf900 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:30.846343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-1dc9a8a7-a1a1-4cd9-88e8-6123946bf900 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:30.857700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1dc9a8a7-a1a1-4cd9-88e8-6123946bf900 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.294772 Sep 08 13:53:30.869902 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 76/146] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:30 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:30.893895 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ac5fd692-05fe-4901-9a15-19bcb0b3bec6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:30.894512 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ac5fd692-05fe-4901-9a15-19bcb0b3bec6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:30.903940 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac5fd692-05fe-4901-9a15-19bcb0b3bec6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:30.904433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac5fd692-05fe-4901-9a15-19bcb0b3bec6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:30.905421 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac5fd692-05fe-4901-9a15-19bcb0b3bec6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:30.906147 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac5fd692-05fe-4901-9a15-19bcb0b3bec6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:30.906603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac5fd692-05fe-4901-9a15-19bcb0b3bec6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:30.907030 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ac5fd692-05fe-4901-9a15-19bcb0b3bec6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:31.124429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ac5fd692-05fe-4901-9a15-19bcb0b3bec6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:31.134446 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ac5fd692-05fe-4901-9a15-19bcb0b3bec6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.244360 Sep 08 13:53:31.135059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 71/147] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:30 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:31.884090 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08d484d2-10b3-4cc3-a6e6-41dd653a9d45 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:31.884831 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08d484d2-10b3-4cc3-a6e6-41dd653a9d45 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:31.904254 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d484d2-10b3-4cc3-a6e6-41dd653a9d45 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:31.904963 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d484d2-10b3-4cc3-a6e6-41dd653a9d45 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:31.905565 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d484d2-10b3-4cc3-a6e6-41dd653a9d45 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:31.906555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d484d2-10b3-4cc3-a6e6-41dd653a9d45 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:31.907318 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d484d2-10b3-4cc3-a6e6-41dd653a9d45 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:31.908007 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d484d2-10b3-4cc3-a6e6-41dd653a9d45 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:32.142348 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-08d484d2-10b3-4cc3-a6e6-41dd653a9d45 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:32.146502 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:32.159605 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08d484d2-10b3-4cc3-a6e6-41dd653a9d45 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.279750 Sep 08 13:53:32.160701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 77/148] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:31 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:32.162666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-742f30f6-0650-451d-8ced-dfe97a110770 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:32.164081 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-742f30f6-0650-451d-8ced-dfe97a110770 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:32.191780 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-742f30f6-0650-451d-8ced-dfe97a110770 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:32.192791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-742f30f6-0650-451d-8ced-dfe97a110770 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:32.193716 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-742f30f6-0650-451d-8ced-dfe97a110770 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:32.195035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-742f30f6-0650-451d-8ced-dfe97a110770 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:32.195810 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-742f30f6-0650-451d-8ced-dfe97a110770 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:32.196562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-742f30f6-0650-451d-8ced-dfe97a110770 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:32.446186 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1063554336", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:32.499226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-742f30f6-0650-451d-8ced-dfe97a110770 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:32.510893 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-742f30f6-0650-451d-8ced-dfe97a110770 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1362 microversion: 2.1 time: 0.355810 Sep 08 13:53:32.526497 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 72/149] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:32 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:32.533312 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=82 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:32.566944 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] validate_networks() for None {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:53:33.188788 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ccc58f7e-a296-4956-83f6-eee018d5c4f5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:33.204270 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ccc58f7e-a296-4956-83f6-eee018d5c4f5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:33.208346 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:53:33.208928 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:53:33.209224 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:53:33.209837 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:53:33.210401 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:53:33.211068 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccc58f7e-a296-4956-83f6-eee018d5c4f5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:33.211999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccc58f7e-a296-4956-83f6-eee018d5c4f5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:33.212523 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccc58f7e-a296-4956-83f6-eee018d5c4f5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:33.213314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccc58f7e-a296-4956-83f6-eee018d5c4f5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:33.214012 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccc58f7e-a296-4956-83f6-eee018d5c4f5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:33.214538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ccc58f7e-a296-4956-83f6-eee018d5c4f5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:33.223437 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:33.224552 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:33.225297 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:33.226374 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:33.226991 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:33.227565 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:33.239174 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:33.247931 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Getting quotas for project 06929ea6da40417394a9274b2c86c96a. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:53:33.252488 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Getting quotas for user e60401b675bb4dff9ebc12b6076fdd3f and project 06929ea6da40417394a9274b2c86c96a. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:53:33.265245 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:53:33.268105 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:53:33.373840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17544c1b-eb90-4c93-8b49-c4d0d0162597 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.948440 Sep 08 13:53:33.378447 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 78/150] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:53:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:53:33.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e9b226a-2a7a-4e22-9d76-70b31ececc1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:33.395004 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e9b226a-2a7a-4e22-9d76-70b31ececc1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:33.573541 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e9b226a-2a7a-4e22-9d76-70b31ececc1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:33.581201 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e9b226a-2a7a-4e22-9d76-70b31ececc1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1215 microversion: 2.1 time: 0.195004 Sep 08 13:53:33.581837 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 79/151] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:33 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:33.596046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4da0b918-afac-4b57-aa23-26fb5f7d1a9b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:33.596981 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4da0b918-afac-4b57-aa23-26fb5f7d1a9b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:33.604891 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4da0b918-afac-4b57-aa23-26fb5f7d1a9b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:33.605992 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4da0b918-afac-4b57-aa23-26fb5f7d1a9b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:33.606554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4da0b918-afac-4b57-aa23-26fb5f7d1a9b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:33.607399 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4da0b918-afac-4b57-aa23-26fb5f7d1a9b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:33.607964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4da0b918-afac-4b57-aa23-26fb5f7d1a9b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:33.608464 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4da0b918-afac-4b57-aa23-26fb5f7d1a9b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:33.936766 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ccc58f7e-a296-4956-83f6-eee018d5c4f5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:33.947594 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ccc58f7e-a296-4956-83f6-eee018d5c4f5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.763179 Sep 08 13:53:33.948187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 73/152] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:33 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:34.106084 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-4da0b918-afac-4b57-aa23-26fb5f7d1a9b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:34.115398 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4da0b918-afac-4b57-aa23-26fb5f7d1a9b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1547 microversion: 2.1 time: 0.524397 Sep 08 13:53:34.115988 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 80/153] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:33 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1547 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:34.143481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-86e26617-b8a9-4460-997d-a943b75ff85e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:34.143952 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-86e26617-b8a9-4460-997d-a943b75ff85e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:34.145886 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=92 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:34.150923 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e26617-b8a9-4460-997d-a943b75ff85e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:34.151404 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e26617-b8a9-4460-997d-a943b75ff85e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:34.151844 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e26617-b8a9-4460-997d-a943b75ff85e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:34.152542 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e26617-b8a9-4460-997d-a943b75ff85e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:34.153047 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e26617-b8a9-4460-997d-a943b75ff85e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:34.153475 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-86e26617-b8a9-4460-997d-a943b75ff85e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:34.273572 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-86e26617-b8a9-4460-997d-a943b75ff85e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134044 Sep 08 13:53:34.274901 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 74/154] 10.222.0.55 () {58 vars in 1275 bytes} [Thu Sep 8 13:53:34 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:34.611349 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e9f26a1b-ac50-422e-91fb-1ab6011a4ca2 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:34.611966 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e9f26a1b-ac50-422e-91fb-1ab6011a4ca2 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:34.625079 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9f26a1b-ac50-422e-91fb-1ab6011a4ca2 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:34.626153 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9f26a1b-ac50-422e-91fb-1ab6011a4ca2 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:34.627712 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9f26a1b-ac50-422e-91fb-1ab6011a4ca2 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:34.628669 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9f26a1b-ac50-422e-91fb-1ab6011a4ca2 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:34.630324 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9f26a1b-ac50-422e-91fb-1ab6011a4ca2 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:34.634944 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9f26a1b-ac50-422e-91fb-1ab6011a4ca2 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:34.754336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e9f26a1b-ac50-422e-91fb-1ab6011a4ca2 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:34.772170 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e9f26a1b-ac50-422e-91fb-1ab6011a4ca2 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1211 microversion: 2.1 time: 0.171498 Sep 08 13:53:34.791905 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 81/155] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:34 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1211 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:34.972642 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eedda000-603e-4825-84c7-8db2f515d5dc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:34.973280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eedda000-603e-4825-84c7-8db2f515d5dc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:34.981549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eedda000-603e-4825-84c7-8db2f515d5dc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:34.982230 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eedda000-603e-4825-84c7-8db2f515d5dc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:34.983781 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eedda000-603e-4825-84c7-8db2f515d5dc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:34.984637 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eedda000-603e-4825-84c7-8db2f515d5dc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:34.985388 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eedda000-603e-4825-84c7-8db2f515d5dc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:34.990307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eedda000-603e-4825-84c7-8db2f515d5dc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:35.261423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-eedda000-603e-4825-84c7-8db2f515d5dc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:35.275195 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eedda000-603e-4825-84c7-8db2f515d5dc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.307490 Sep 08 13:53:35.276169 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 75/156] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:34 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:35.799099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f3c9ff5-f204-4fac-bd4c-6ec349b92e68 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:35.799916 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1f3c9ff5-f204-4fac-bd4c-6ec349b92e68 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:35.810506 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f3c9ff5-f204-4fac-bd4c-6ec349b92e68 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:35.815853 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f3c9ff5-f204-4fac-bd4c-6ec349b92e68 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:35.816622 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f3c9ff5-f204-4fac-bd4c-6ec349b92e68 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:35.817461 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f3c9ff5-f204-4fac-bd4c-6ec349b92e68 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:35.818047 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f3c9ff5-f204-4fac-bd4c-6ec349b92e68 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:35.818547 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f3c9ff5-f204-4fac-bd4c-6ec349b92e68 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:35.943581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-1f3c9ff5-f204-4fac-bd4c-6ec349b92e68 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:35.953259 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f3c9ff5-f204-4fac-bd4c-6ec349b92e68 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1267 microversion: 2.1 time: 0.158010 Sep 08 13:53:35.961552 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 82/157] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:35 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:36.299913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ade88406-61a5-4962-9618-0ed098a0c8a3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:36.301959 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ade88406-61a5-4962-9618-0ed098a0c8a3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:36.314030 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ade88406-61a5-4962-9618-0ed098a0c8a3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:36.320809 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ade88406-61a5-4962-9618-0ed098a0c8a3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:36.321936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ade88406-61a5-4962-9618-0ed098a0c8a3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:36.323480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ade88406-61a5-4962-9618-0ed098a0c8a3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:36.324374 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ade88406-61a5-4962-9618-0ed098a0c8a3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:36.325407 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ade88406-61a5-4962-9618-0ed098a0c8a3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:36.850650 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ade88406-61a5-4962-9618-0ed098a0c8a3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:36.868582 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ade88406-61a5-4962-9618-0ed098a0c8a3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.564229 Sep 08 13:53:36.869337 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 76/158] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:36 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:36.912015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e37f7cca-6632-4269-9047-90b5736357de req-060b2c2c-24f6-481c-8ecb-8c28149bf8fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ad7906-3b73-4fc9-a692-9692fb6234b3", "tag": "86699af9-4b49-40e3-b189-ff4a7a9e5e59"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:36.961542 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e37f7cca-6632-4269-9047-90b5736357de req-060b2c2c-24f6-481c-8ecb-8c28149bf8fc service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:36.962834 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e37f7cca-6632-4269-9047-90b5736357de req-060b2c2c-24f6-481c-8ecb-8c28149bf8fc service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:36.966127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e37f7cca-6632-4269-9047-90b5736357de req-060b2c2c-24f6-481c-8ecb-8c28149bf8fc service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:36.977149 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3a75b42f-6462-4138-bcda-fb2386840376 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:36.978523 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3a75b42f-6462-4138-bcda-fb2386840376 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:36.992433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a75b42f-6462-4138-bcda-fb2386840376 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:36.992915 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a75b42f-6462-4138-bcda-fb2386840376 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:36.993567 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a75b42f-6462-4138-bcda-fb2386840376 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:36.994562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a75b42f-6462-4138-bcda-fb2386840376 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:36.995342 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a75b42f-6462-4138-bcda-fb2386840376 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:36.996545 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a75b42f-6462-4138-bcda-fb2386840376 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:37.008448 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e37f7cca-6632-4269-9047-90b5736357de req-060b2c2c-24f6-481c-8ecb-8c28149bf8fc service nova] Creating event network-changed:86699af9-4b49-40e3-b189-ff4a7a9e5e59 for instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 on hv-cinder-82002 Sep 08 13:53:37.023615 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e37f7cca-6632-4269-9047-90b5736357de req-060b2c2c-24f6-481c-8ecb-8c28149bf8fc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113212 Sep 08 13:53:37.025137 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 83/159] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:37.209143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3a75b42f-6462-4138-bcda-fb2386840376 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:37.233096 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3a75b42f-6462-4138-bcda-fb2386840376 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1273 microversion: 2.1 time: 0.257235 Sep 08 13:53:37.238612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 77/160] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:36 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:37.900342 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-59c03de4-5a1e-4d08-a381-48828d3516b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:37.901292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-59c03de4-5a1e-4d08-a381-48828d3516b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:37.912028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c03de4-5a1e-4d08-a381-48828d3516b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:37.912631 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c03de4-5a1e-4d08-a381-48828d3516b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:37.912940 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c03de4-5a1e-4d08-a381-48828d3516b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:37.914094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c03de4-5a1e-4d08-a381-48828d3516b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:37.914094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c03de4-5a1e-4d08-a381-48828d3516b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:37.914532 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59c03de4-5a1e-4d08-a381-48828d3516b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:38.230354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-59c03de4-5a1e-4d08-a381-48828d3516b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:38.245380 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-59c03de4-5a1e-4d08-a381-48828d3516b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.348948 Sep 08 13:53:38.246022 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 84/161] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:37 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:38.271609 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ee6b238-2112-4c58-b0df-116832e5d26d tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:38.273273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ee6b238-2112-4c58-b0df-116832e5d26d tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:38.287523 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ee6b238-2112-4c58-b0df-116832e5d26d tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:38.288407 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ee6b238-2112-4c58-b0df-116832e5d26d tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:38.289062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ee6b238-2112-4c58-b0df-116832e5d26d tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:38.290121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ee6b238-2112-4c58-b0df-116832e5d26d tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:38.291697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ee6b238-2112-4c58-b0df-116832e5d26d tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:38.293010 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ee6b238-2112-4c58-b0df-116832e5d26d tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:38.875257 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ee6b238-2112-4c58-b0df-116832e5d26d tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:38.888173 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ee6b238-2112-4c58-b0df-116832e5d26d tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.624828 Sep 08 13:53:38.888827 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 78/162] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:38 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:39.270712 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a49de30e-11b8-48e6-9663-260268bccde0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:39.271735 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a49de30e-11b8-48e6-9663-260268bccde0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:39.284349 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a49de30e-11b8-48e6-9663-260268bccde0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:39.285270 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a49de30e-11b8-48e6-9663-260268bccde0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:39.285979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a49de30e-11b8-48e6-9663-260268bccde0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:39.286925 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a49de30e-11b8-48e6-9663-260268bccde0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:39.287640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a49de30e-11b8-48e6-9663-260268bccde0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:39.288268 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a49de30e-11b8-48e6-9663-260268bccde0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:39.476757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a49de30e-11b8-48e6-9663-260268bccde0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:39.486309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a49de30e-11b8-48e6-9663-260268bccde0 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.220679 Sep 08 13:53:39.487416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 85/163] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:39 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:39.919226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-63c91bf6-a9e3-48e7-ab97-40be47165aa1 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:39.919743 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-63c91bf6-a9e3-48e7-ab97-40be47165aa1 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:39.942508 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63c91bf6-a9e3-48e7-ab97-40be47165aa1 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:39.943317 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63c91bf6-a9e3-48e7-ab97-40be47165aa1 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:39.944914 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63c91bf6-a9e3-48e7-ab97-40be47165aa1 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:39.946097 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63c91bf6-a9e3-48e7-ab97-40be47165aa1 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:39.946645 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63c91bf6-a9e3-48e7-ab97-40be47165aa1 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:39.947076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-63c91bf6-a9e3-48e7-ab97-40be47165aa1 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:40.126082 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-63c91bf6-a9e3-48e7-ab97-40be47165aa1 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:40.135614 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-63c91bf6-a9e3-48e7-ab97-40be47165aa1 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.220511 Sep 08 13:53:40.151345 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 79/164] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:39 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:40.510981 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7f164e87-a674-4e0b-a63b-3ddcf03108a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:40.511806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7f164e87-a674-4e0b-a63b-3ddcf03108a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:40.526610 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f164e87-a674-4e0b-a63b-3ddcf03108a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:40.527103 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f164e87-a674-4e0b-a63b-3ddcf03108a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:40.528526 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f164e87-a674-4e0b-a63b-3ddcf03108a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:40.529249 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f164e87-a674-4e0b-a63b-3ddcf03108a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:40.530029 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f164e87-a674-4e0b-a63b-3ddcf03108a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:40.530465 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f164e87-a674-4e0b-a63b-3ddcf03108a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:40.716760 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7f164e87-a674-4e0b-a63b-3ddcf03108a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:40.740518 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7f164e87-a674-4e0b-a63b-3ddcf03108a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.233198 Sep 08 13:53:40.741654 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 86/165] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:40 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:41.160051 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-61cb55f1-3167-48e4-a18f-5db5a304e9ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:41.161691 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-61cb55f1-3167-48e4-a18f-5db5a304e9ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:41.177356 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cb55f1-3167-48e4-a18f-5db5a304e9ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:41.192110 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cb55f1-3167-48e4-a18f-5db5a304e9ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:41.193040 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cb55f1-3167-48e4-a18f-5db5a304e9ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:41.194375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cb55f1-3167-48e4-a18f-5db5a304e9ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:41.215051 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cb55f1-3167-48e4-a18f-5db5a304e9ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:41.215874 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cb55f1-3167-48e4-a18f-5db5a304e9ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:41.648852 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-61cb55f1-3167-48e4-a18f-5db5a304e9ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:41.717012 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-61cb55f1-3167-48e4-a18f-5db5a304e9ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.561679 Sep 08 13:53:41.722165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 80/166] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:41 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:41.774384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-87406ae9-f2a7-4aba-80ec-698c590b8dd4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:41.780221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-87406ae9-f2a7-4aba-80ec-698c590b8dd4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:41.798580 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87406ae9-f2a7-4aba-80ec-698c590b8dd4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:41.800266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87406ae9-f2a7-4aba-80ec-698c590b8dd4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:41.805703 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87406ae9-f2a7-4aba-80ec-698c590b8dd4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:41.807390 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87406ae9-f2a7-4aba-80ec-698c590b8dd4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:41.808435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87406ae9-f2a7-4aba-80ec-698c590b8dd4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:41.809545 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-87406ae9-f2a7-4aba-80ec-698c590b8dd4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:42.271523 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-87406ae9-f2a7-4aba-80ec-698c590b8dd4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:42.288768 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-87406ae9-f2a7-4aba-80ec-698c590b8dd4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.524487 Sep 08 13:53:42.289629 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 87/167] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:41 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:42.411211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f081c0e9-4790-47d4-a89f-45ed6cb9a349 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:42.412004 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f081c0e9-4790-47d4-a89f-45ed6cb9a349 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:42.433362 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f081c0e9-4790-47d4-a89f-45ed6cb9a349 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:42.433908 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f081c0e9-4790-47d4-a89f-45ed6cb9a349 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:42.435622 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f081c0e9-4790-47d4-a89f-45ed6cb9a349 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:42.437662 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f081c0e9-4790-47d4-a89f-45ed6cb9a349 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:42.440335 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f081c0e9-4790-47d4-a89f-45ed6cb9a349 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:42.442413 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f081c0e9-4790-47d4-a89f-45ed6cb9a349 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:42.517690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f081c0e9-4790-47d4-a89f-45ed6cb9a349 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:53:42.695132 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f081c0e9-4790-47d4-a89f-45ed6cb9a349 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 204 len: 0 microversion: 2.1 time: 0.287724 Sep 08 13:53:42.698104 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 81/168] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:53:42 2022] DELETE /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:53:42.710362 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-61e0df69-1547-4967-acbb-c96d33855f04 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:42.711166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-61e0df69-1547-4967-acbb-c96d33855f04 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:42.747131 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7ae1de0e-6ba6-4136-83e0-c8946d4de6cb tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:42.747922 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7ae1de0e-6ba6-4136-83e0-c8946d4de6cb tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:42.750613 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61e0df69-1547-4967-acbb-c96d33855f04 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:42.752552 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61e0df69-1547-4967-acbb-c96d33855f04 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:42.753129 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61e0df69-1547-4967-acbb-c96d33855f04 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:42.757128 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61e0df69-1547-4967-acbb-c96d33855f04 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:42.757660 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61e0df69-1547-4967-acbb-c96d33855f04 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:42.759368 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-61e0df69-1547-4967-acbb-c96d33855f04 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:42.760302 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1de0e-6ba6-4136-83e0-c8946d4de6cb tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:42.763038 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1de0e-6ba6-4136-83e0-c8946d4de6cb tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:42.763685 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1de0e-6ba6-4136-83e0-c8946d4de6cb tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:42.766144 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1de0e-6ba6-4136-83e0-c8946d4de6cb tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:42.767815 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1de0e-6ba6-4136-83e0-c8946d4de6cb tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:42.769042 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ae1de0e-6ba6-4136-83e0-c8946d4de6cb tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:43.123847 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7ae1de0e-6ba6-4136-83e0-c8946d4de6cb tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:43.138468 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7ae1de0e-6ba6-4136-83e0-c8946d4de6cb tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.395797 Sep 08 13:53:43.160797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 82/169] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:42 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:43.167988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ec30d5fa-7172-4179-88c3-149027ff89af req-24f89b58-15f2-4c25-bf7e-b9a657e09e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143f215b-f987-440e-afa1-d699e0a52772", "tag": "2242daf3-b604-43fa-82a6-ac2fe5188b1d"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:43.216888 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ec30d5fa-7172-4179-88c3-149027ff89af req-24f89b58-15f2-4c25-bf7e-b9a657e09e4a service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:43.227777 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ec30d5fa-7172-4179-88c3-149027ff89af req-24f89b58-15f2-4c25-bf7e-b9a657e09e4a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:43.228915 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ec30d5fa-7172-4179-88c3-149027ff89af req-24f89b58-15f2-4c25-bf7e-b9a657e09e4a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:43.242250 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:43.242937 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ec30d5fa-7172-4179-88c3-149027ff89af req-24f89b58-15f2-4c25-bf7e-b9a657e09e4a service nova] Creating event network-changed:2242daf3-b604-43fa-82a6-ac2fe5188b1d for instance 143f215b-f987-440e-afa1-d699e0a52772 on hv-cinder-82002 Sep 08 13:53:43.249249 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ec30d5fa-7172-4179-88c3-149027ff89af req-24f89b58-15f2-4c25-bf7e-b9a657e09e4a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086535 Sep 08 13:53:43.249833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 83/170] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:43.260709 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-61e0df69-1547-4967-acbb-c96d33855f04 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:43.275250 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-61e0df69-1547-4967-acbb-c96d33855f04 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1551 microversion: 2.1 time: 0.571871 Sep 08 13:53:43.290138 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 88/171] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:42 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1551 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:43.353637 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-565372fe-cad6-4661-a29c-3da702690f4b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:43.354299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-565372fe-cad6-4661-a29c-3da702690f4b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:43.362073 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565372fe-cad6-4661-a29c-3da702690f4b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:43.363060 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565372fe-cad6-4661-a29c-3da702690f4b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:43.363506 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565372fe-cad6-4661-a29c-3da702690f4b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:43.364497 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565372fe-cad6-4661-a29c-3da702690f4b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:43.364960 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565372fe-cad6-4661-a29c-3da702690f4b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:43.365395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-565372fe-cad6-4661-a29c-3da702690f4b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:43.611281 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-565372fe-cad6-4661-a29c-3da702690f4b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:43.620574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-565372fe-cad6-4661-a29c-3da702690f4b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.271349 Sep 08 13:53:43.622237 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 84/172] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:43 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:44.166367 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2b305c6e-a80d-44bf-959d-f485ae1190f6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:44.168010 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2b305c6e-a80d-44bf-959d-f485ae1190f6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:44.175284 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:44.178930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b305c6e-a80d-44bf-959d-f485ae1190f6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:44.179687 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b305c6e-a80d-44bf-959d-f485ae1190f6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:44.180379 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b305c6e-a80d-44bf-959d-f485ae1190f6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:44.181587 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b305c6e-a80d-44bf-959d-f485ae1190f6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:44.182274 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b305c6e-a80d-44bf-959d-f485ae1190f6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:44.183068 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b305c6e-a80d-44bf-959d-f485ae1190f6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:44.301706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9b03e8a8-c3c0-48dd-a63b-a8b5fe423a29 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:44.304303 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9b03e8a8-c3c0-48dd-a63b-a8b5fe423a29 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:44.310708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b03e8a8-c3c0-48dd-a63b-a8b5fe423a29 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:44.312644 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b03e8a8-c3c0-48dd-a63b-a8b5fe423a29 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:44.314223 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b03e8a8-c3c0-48dd-a63b-a8b5fe423a29 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:44.315159 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b03e8a8-c3c0-48dd-a63b-a8b5fe423a29 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:44.316063 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b03e8a8-c3c0-48dd-a63b-a8b5fe423a29 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:44.316582 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9b03e8a8-c3c0-48dd-a63b-a8b5fe423a29 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:44.417899 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b305c6e-a80d-44bf-959d-f485ae1190f6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:44.432123 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2b305c6e-a80d-44bf-959d-f485ae1190f6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.269646 Sep 08 13:53:44.447597 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 89/173] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:44 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:44.627352 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9b03e8a8-c3c0-48dd-a63b-a8b5fe423a29 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:44.644731 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1a52353-67ef-42d8-830a-b9b25b9c6dc1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:44.645590 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a1a52353-67ef-42d8-830a-b9b25b9c6dc1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:44.646014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9b03e8a8-c3c0-48dd-a63b-a8b5fe423a29 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1551 microversion: 2.1 time: 0.348005 Sep 08 13:53:44.646610 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 85/174] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:44 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1551 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:44.652732 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a52353-67ef-42d8-830a-b9b25b9c6dc1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:44.653461 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a52353-67ef-42d8-830a-b9b25b9c6dc1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:44.654116 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a52353-67ef-42d8-830a-b9b25b9c6dc1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:44.655055 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a52353-67ef-42d8-830a-b9b25b9c6dc1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:44.655509 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a52353-67ef-42d8-830a-b9b25b9c6dc1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:44.655924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1a52353-67ef-42d8-830a-b9b25b9c6dc1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:44.895877 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a1a52353-67ef-42d8-830a-b9b25b9c6dc1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:44.910777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a1a52353-67ef-42d8-830a-b9b25b9c6dc1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.268871 Sep 08 13:53:44.911386 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 90/175] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:44 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:45.459335 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e3911be1-d75c-470e-8ed1-23f477e87f1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:45.460033 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e3911be1-d75c-470e-8ed1-23f477e87f1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:45.466727 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3911be1-d75c-470e-8ed1-23f477e87f1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:45.467542 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3911be1-d75c-470e-8ed1-23f477e87f1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:45.467984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3911be1-d75c-470e-8ed1-23f477e87f1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:45.471167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3911be1-d75c-470e-8ed1-23f477e87f1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:45.471926 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3911be1-d75c-470e-8ed1-23f477e87f1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:45.473258 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e3911be1-d75c-470e-8ed1-23f477e87f1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:45.672060 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1c79b61b-4618-4e63-90a9-845c6e946276 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:45.673267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1c79b61b-4618-4e63-90a9-845c6e946276 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:45.682552 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79b61b-4618-4e63-90a9-845c6e946276 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:45.687768 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79b61b-4618-4e63-90a9-845c6e946276 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:45.688223 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79b61b-4618-4e63-90a9-845c6e946276 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:45.688963 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79b61b-4618-4e63-90a9-845c6e946276 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:45.689418 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79b61b-4618-4e63-90a9-845c6e946276 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:45.689872 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c79b61b-4618-4e63-90a9-845c6e946276 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:45.765059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e3911be1-d75c-470e-8ed1-23f477e87f1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:45.774379 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e3911be1-d75c-470e-8ed1-23f477e87f1c tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.319434 Sep 08 13:53:45.781225 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 86/176] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:45 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:45.907463 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-1c79b61b-4618-4e63-90a9-845c6e946276 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:45.917880 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1c79b61b-4618-4e63-90a9-845c6e946276 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1551 microversion: 2.1 time: 0.250438 Sep 08 13:53:45.920205 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 91/177] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:45 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1551 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:45.942218 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c73fb6a4-2285-46bf-9f94-9d05db0f5c90 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:45.942841 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c73fb6a4-2285-46bf-9f94-9d05db0f5c90 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:45.950416 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c73fb6a4-2285-46bf-9f94-9d05db0f5c90 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:45.950920 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c73fb6a4-2285-46bf-9f94-9d05db0f5c90 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:45.952794 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c73fb6a4-2285-46bf-9f94-9d05db0f5c90 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:45.954427 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c73fb6a4-2285-46bf-9f94-9d05db0f5c90 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:45.954746 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c73fb6a4-2285-46bf-9f94-9d05db0f5c90 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:45.955436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c73fb6a4-2285-46bf-9f94-9d05db0f5c90 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:46.190817 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c73fb6a4-2285-46bf-9f94-9d05db0f5c90 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:46.205791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c73fb6a4-2285-46bf-9f94-9d05db0f5c90 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.264187 Sep 08 13:53:46.205791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 87/178] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:45 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:46.802732 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-12c7fdce-414f-4e61-8430-71cedda23b3f tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:46.803399 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-12c7fdce-414f-4e61-8430-71cedda23b3f tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:46.813125 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12c7fdce-414f-4e61-8430-71cedda23b3f tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:46.814198 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12c7fdce-414f-4e61-8430-71cedda23b3f tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:46.814790 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12c7fdce-414f-4e61-8430-71cedda23b3f tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:46.815955 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12c7fdce-414f-4e61-8430-71cedda23b3f tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:46.816553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12c7fdce-414f-4e61-8430-71cedda23b3f tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:46.817472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12c7fdce-414f-4e61-8430-71cedda23b3f tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:46.944527 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9e9e9111-ec97-4403-ba44-8683108cb7d0 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:46.946336 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9e9e9111-ec97-4403-ba44-8683108cb7d0 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:46.956995 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e9e9111-ec97-4403-ba44-8683108cb7d0 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:46.957973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e9e9111-ec97-4403-ba44-8683108cb7d0 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:46.958771 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e9e9111-ec97-4403-ba44-8683108cb7d0 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:46.959955 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e9e9111-ec97-4403-ba44-8683108cb7d0 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:46.960623 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e9e9111-ec97-4403-ba44-8683108cb7d0 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:46.961266 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e9e9111-ec97-4403-ba44-8683108cb7d0 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:47.280831 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-12c7fdce-414f-4e61-8430-71cedda23b3f tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:47.289776 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-12c7fdce-414f-4e61-8430-71cedda23b3f tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.490696 Sep 08 13:53:47.294580 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 92/179] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:46 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:47.310703 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b2e030cc-c782-4e7c-868b-f4e4bf13db4f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:47.317912 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b2e030cc-c782-4e7c-868b-f4e4bf13db4f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:47.345603 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2e030cc-c782-4e7c-868b-f4e4bf13db4f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:47.347921 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2e030cc-c782-4e7c-868b-f4e4bf13db4f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:47.348422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2e030cc-c782-4e7c-868b-f4e4bf13db4f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:47.350852 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2e030cc-c782-4e7c-868b-f4e4bf13db4f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:47.351488 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2e030cc-c782-4e7c-868b-f4e4bf13db4f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:47.352066 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2e030cc-c782-4e7c-868b-f4e4bf13db4f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:47.510852 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9e9e9111-ec97-4403-ba44-8683108cb7d0 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:47.522693 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9e9e9111-ec97-4403-ba44-8683108cb7d0 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1551 microversion: 2.1 time: 0.581488 Sep 08 13:53:47.525211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 88/180] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:46 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1551 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:47.650525 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b2e030cc-c782-4e7c-868b-f4e4bf13db4f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:47.650525 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b2e030cc-c782-4e7c-868b-f4e4bf13db4f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.353344 Sep 08 13:53:47.650525 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 93/181] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:47 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:48.121430 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-88f3d4d0-2ff6-4786-b986-bc4ae3978ef8 req-3b85cd48-4a02-4419-b48b-f35ef96e2811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a4e6c3b-d230-477f-b406-5f55ec596b1e", "name": "network-vif-deleted", "tag": "2e9cdac8-d126-4ec3-8459-aaf58c0148d7"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:48.131993 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-88f3d4d0-2ff6-4786-b986-bc4ae3978ef8 req-3b85cd48-4a02-4419-b48b-f35ef96e2811 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:48.133384 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-88f3d4d0-2ff6-4786-b986-bc4ae3978ef8 req-3b85cd48-4a02-4419-b48b-f35ef96e2811 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:48.133843 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-88f3d4d0-2ff6-4786-b986-bc4ae3978ef8 req-3b85cd48-4a02-4419-b48b-f35ef96e2811 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:48.137901 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:48.147449 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-88f3d4d0-2ff6-4786-b986-bc4ae3978ef8 req-3b85cd48-4a02-4419-b48b-f35ef96e2811 service nova] Creating event network-vif-deleted:2e9cdac8-d126-4ec3-8459-aaf58c0148d7 for instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e on hv-cinder-82002 Sep 08 13:53:48.153085 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-88f3d4d0-2ff6-4786-b986-bc4ae3978ef8 req-3b85cd48-4a02-4419-b48b-f35ef96e2811 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035363 Sep 08 13:53:48.153808 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 89/182] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:48.323567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-57abed3a-2194-4a9a-81ac-81a717f9a5ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:48.324242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-57abed3a-2194-4a9a-81ac-81a717f9a5ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:48.331789 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57abed3a-2194-4a9a-81ac-81a717f9a5ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:48.332285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57abed3a-2194-4a9a-81ac-81a717f9a5ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:48.332719 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57abed3a-2194-4a9a-81ac-81a717f9a5ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:48.333426 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57abed3a-2194-4a9a-81ac-81a717f9a5ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:48.334083 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57abed3a-2194-4a9a-81ac-81a717f9a5ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:48.334655 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-57abed3a-2194-4a9a-81ac-81a717f9a5ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:48.499615 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-57abed3a-2194-4a9a-81ac-81a717f9a5ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:48.508510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-57abed3a-2194-4a9a-81ac-81a717f9a5ba tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.195644 Sep 08 13:53:48.509185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 94/183] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:48 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:48.547557 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ec8bad05-55d6-4be5-9843-fd0df096b62c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:48.548255 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ec8bad05-55d6-4be5-9843-fd0df096b62c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:48.556500 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec8bad05-55d6-4be5-9843-fd0df096b62c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:48.557465 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec8bad05-55d6-4be5-9843-fd0df096b62c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:48.557926 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec8bad05-55d6-4be5-9843-fd0df096b62c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:48.558965 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec8bad05-55d6-4be5-9843-fd0df096b62c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:48.559482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec8bad05-55d6-4be5-9843-fd0df096b62c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:48.559906 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ec8bad05-55d6-4be5-9843-fd0df096b62c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:48.634709 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ec8bad05-55d6-4be5-9843-fd0df096b62c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:48.643323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ec8bad05-55d6-4be5-9843-fd0df096b62c tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1509 microversion: 2.1 time: 0.100440 Sep 08 13:53:48.646672 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 90/184] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:48 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1509 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:48.677828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8856a2f-9001-4436-8d25-a4398bd4507b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:48.678615 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a8856a2f-9001-4436-8d25-a4398bd4507b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:48.685051 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8856a2f-9001-4436-8d25-a4398bd4507b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:48.685685 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8856a2f-9001-4436-8d25-a4398bd4507b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:48.686354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8856a2f-9001-4436-8d25-a4398bd4507b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:48.687214 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8856a2f-9001-4436-8d25-a4398bd4507b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:48.687806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8856a2f-9001-4436-8d25-a4398bd4507b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:48.688638 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8856a2f-9001-4436-8d25-a4398bd4507b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:48.830197 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8856a2f-9001-4436-8d25-a4398bd4507b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:48.840944 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8856a2f-9001-4436-8d25-a4398bd4507b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.166959 Sep 08 13:53:48.841601 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 95/185] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:48 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:49.538634 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a188560b-fc6b-442f-8c62-2f329f054654 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:49.539895 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a188560b-fc6b-442f-8c62-2f329f054654 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:49.553210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a188560b-fc6b-442f-8c62-2f329f054654 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:49.555686 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a188560b-fc6b-442f-8c62-2f329f054654 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:49.556482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a188560b-fc6b-442f-8c62-2f329f054654 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:49.557448 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a188560b-fc6b-442f-8c62-2f329f054654 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:49.561230 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a188560b-fc6b-442f-8c62-2f329f054654 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:49.561956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a188560b-fc6b-442f-8c62-2f329f054654 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:49.671789 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-21fcdbf3-3aff-49fb-aeee-d783091067eb tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:49.673869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-21fcdbf3-3aff-49fb-aeee-d783091067eb tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:49.689501 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21fcdbf3-3aff-49fb-aeee-d783091067eb tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:49.690623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21fcdbf3-3aff-49fb-aeee-d783091067eb tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:49.692756 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21fcdbf3-3aff-49fb-aeee-d783091067eb tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:49.696031 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21fcdbf3-3aff-49fb-aeee-d783091067eb tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:49.697800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21fcdbf3-3aff-49fb-aeee-d783091067eb tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:49.698545 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-21fcdbf3-3aff-49fb-aeee-d783091067eb tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:49.744338 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a188560b-fc6b-442f-8c62-2f329f054654 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:49.762270 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a188560b-fc6b-442f-8c62-2f329f054654 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.234612 Sep 08 13:53:49.778406 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 91/186] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:49 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:49.798675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-21fcdbf3-3aff-49fb-aeee-d783091067eb tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:49.804610 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:49.827040 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-21fcdbf3-3aff-49fb-aeee-d783091067eb tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1345 microversion: 2.1 time: 0.154768 Sep 08 13:53:49.830961 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 96/187] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:49 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1345 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:49.869697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d966fd8e-f883-4e72-aaf2-f9d22aadfe04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:49.870465 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d966fd8e-f883-4e72-aaf2-f9d22aadfe04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:49.878089 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d966fd8e-f883-4e72-aaf2-f9d22aadfe04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:49.879003 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d966fd8e-f883-4e72-aaf2-f9d22aadfe04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:49.879783 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d966fd8e-f883-4e72-aaf2-f9d22aadfe04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:49.881321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d966fd8e-f883-4e72-aaf2-f9d22aadfe04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:49.881899 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d966fd8e-f883-4e72-aaf2-f9d22aadfe04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:49.882584 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d966fd8e-f883-4e72-aaf2-f9d22aadfe04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:50.151309 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d966fd8e-f883-4e72-aaf2-f9d22aadfe04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:50.169060 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d966fd8e-f883-4e72-aaf2-f9d22aadfe04 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.302920 Sep 08 13:53:50.170370 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 92/188] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:49 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:50.788560 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-af806710-6954-41b7-b738-b8b5c02a38fe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:50.790176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-af806710-6954-41b7-b738-b8b5c02a38fe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:50.797119 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af806710-6954-41b7-b738-b8b5c02a38fe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:50.797882 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af806710-6954-41b7-b738-b8b5c02a38fe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:50.798472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af806710-6954-41b7-b738-b8b5c02a38fe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:50.799412 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af806710-6954-41b7-b738-b8b5c02a38fe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:50.800023 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af806710-6954-41b7-b738-b8b5c02a38fe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:50.800652 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af806710-6954-41b7-b738-b8b5c02a38fe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:50.857282 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:50.857990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:50.865072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:50.865561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:50.866044 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:50.866754 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:50.867234 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:50.867651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:50.940778 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:50.941250 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:50.941683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:50.942168 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lazy-loading 'fault' on Instance uuid 3a4e6c3b-d230-477f-b406-5f55ec596b1e {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:53:51.043301 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d8e06905644ac39777328db72526ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b868b7f8289047369b2fcbb500f353e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:51.069267 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7deb62f3-cd68-45eb-94ba-c533eb2ef2e6 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 200 len: 1350 microversion: 2.1 time: 0.215642 Sep 08 13:53:51.072412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 93/189] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:50 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 1350 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:51.092773 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-af806710-6954-41b7-b738-b8b5c02a38fe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:51.105548 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-af806710-6954-41b7-b738-b8b5c02a38fe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.320394 Sep 08 13:53:51.118451 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 97/190] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:50 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:51.195811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3cb65179-d550-4a16-890c-538bca4fce6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:51.196449 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3cb65179-d550-4a16-890c-538bca4fce6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:51.202245 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb65179-d550-4a16-890c-538bca4fce6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:51.202897 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb65179-d550-4a16-890c-538bca4fce6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:51.203489 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb65179-d550-4a16-890c-538bca4fce6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:51.204445 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb65179-d550-4a16-890c-538bca4fce6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:51.204896 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb65179-d550-4a16-890c-538bca4fce6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:51.205312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cb65179-d550-4a16-890c-538bca4fce6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:51.369950 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3cb65179-d550-4a16-890c-538bca4fce6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:51.379535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3cb65179-d550-4a16-890c-538bca4fce6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.189681 Sep 08 13:53:51.380172 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 94/191] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:51 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:52.101691 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:52.102445 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:52.115662 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:52.115662 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:52.115662 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:52.115662 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:52.116106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:52.116106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:52.130871 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2911eead-a813-4789-aa2e-431b8a134a72 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:52.131488 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2911eead-a813-4789-aa2e-431b8a134a72 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:52.134218 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] HTTP exception thrown: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Request method failure captured: Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e HTTP/1.1 Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOkIrUCcYmotY3QkUNr_-Qqum3R-gHr7fX1nFty1kgRUfkh0GJHRUp4LoBrWeETJ6nuXMUG5mGufJuCk4IGSY6llURVwGhn8yk-4lrEuGBXTVq40GPvh_V8E5qSEQux6oEvlYza9nJTd2jQO3Q90XByEWsk_-KF1jS7trQoEmvM41M Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: b868b7f8289047369b2fcbb500f353e5 Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:53:52.139244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b868b7f8289047369b2fcbb500f353e5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: b868b7f8289047369b2fcbb500f353e5 Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1637109358-project Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 55d8e06905644ac39777328db72526ca Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1637109358-project Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:52.140775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '3a4e6c3b-d230-477f-b406-5f55ec596b1e'} Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:53:52.141664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:52.143099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:53:52.144339 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Returning 404 to user: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:53:52.144339 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-39fd06c4-29ac-4676-b8bd-6c4fb24cb557 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 404 len: 111 microversion: 2.1 time: 0.047742 Sep 08 13:53:52.144597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2911eead-a813-4789-aa2e-431b8a134a72 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:52.144597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2911eead-a813-4789-aa2e-431b8a134a72 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:52.144597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2911eead-a813-4789-aa2e-431b8a134a72 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:52.144597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2911eead-a813-4789-aa2e-431b8a134a72 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:52.144921 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2911eead-a813-4789-aa2e-431b8a134a72 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:52.144921 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2911eead-a813-4789-aa2e-431b8a134a72 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:52.155675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 98/192] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:52 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:53:52.189936 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c66c3fc4-88ab-4bad-8fab-941499bc7cb3 req-e306c044-5433-47dc-9156-85e2c2a6c701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143f215b-f987-440e-afa1-d699e0a52772", "name": "network-vif-plugged", "status": "completed", "tag": "2242daf3-b604-43fa-82a6-ac2fe5188b1d"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:52.203578 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c66c3fc4-88ab-4bad-8fab-941499bc7cb3 req-e306c044-5433-47dc-9156-85e2c2a6c701 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:52.205378 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c66c3fc4-88ab-4bad-8fab-941499bc7cb3 req-e306c044-5433-47dc-9156-85e2c2a6c701 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:52.205867 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c66c3fc4-88ab-4bad-8fab-941499bc7cb3 req-e306c044-5433-47dc-9156-85e2c2a6c701 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:52.253695 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c66c3fc4-88ab-4bad-8fab-941499bc7cb3 req-e306c044-5433-47dc-9156-85e2c2a6c701 service nova] Creating event network-vif-plugged:2242daf3-b604-43fa-82a6-ac2fe5188b1d for instance 143f215b-f987-440e-afa1-d699e0a52772 on hv-cinder-82002 Sep 08 13:53:52.266768 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c66c3fc4-88ab-4bad-8fab-941499bc7cb3 req-e306c044-5433-47dc-9156-85e2c2a6c701 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081108 Sep 08 13:53:52.269170 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 99/193] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:52.324050 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:52.327727 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:52.335448 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:52.338414 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:52.339308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:52.340708 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:52.341539 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:52.343139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:52.393491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] HTTP exception thrown: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Request method failure captured: Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e/os-volume_attachments HTTP/1.1 Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOkIrUCcYmotY3QkUNr_-Qqum3R-gHr7fX1nFty1kgRUfkh0GJHRUp4LoBrWeETJ6nuXMUG5mGufJuCk4IGSY6llURVwGhn8yk-4lrEuGBXTVq40GPvh_V8E5qSEQux6oEvlYza9nJTd2jQO3Q90XByEWsk_-KF1jS7trQoEmvM41M Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: b868b7f8289047369b2fcbb500f353e5 Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:53:52.396621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b868b7f8289047369b2fcbb500f353e5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: b868b7f8289047369b2fcbb500f353e5 Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-DeleteServersTestJSON-1637109358-project Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 55d8e06905644ac39777328db72526ca Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-DeleteServersTestJSON-1637109358-project Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:52.398247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'server_id': '3a4e6c3b-d230-477f-b406-5f55ec596b1e'} Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:53:52.398910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:52.400106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:53:52.404382 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Returning 404 to user: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:53:52.405619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0222dca1-0359-412a-81b5-e7da13463424 tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.085772 Sep 08 13:53:52.410684 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 100/194] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:53:52 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e/os-volume_attachments => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:53:52.416878 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e1908bff-a45c-48b2-81b1-6e0f2b05148a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:52.417657 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e1908bff-a45c-48b2-81b1-6e0f2b05148a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:52.425522 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1908bff-a45c-48b2-81b1-6e0f2b05148a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:52.426396 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1908bff-a45c-48b2-81b1-6e0f2b05148a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:52.427110 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1908bff-a45c-48b2-81b1-6e0f2b05148a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:52.428073 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1908bff-a45c-48b2-81b1-6e0f2b05148a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:52.428708 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1908bff-a45c-48b2-81b1-6e0f2b05148a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:52.429297 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1908bff-a45c-48b2-81b1-6e0f2b05148a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:52.465092 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2911eead-a813-4789-aa2e-431b8a134a72 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:52.486571 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2911eead-a813-4789-aa2e-431b8a134a72 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.347914 Sep 08 13:53:52.486571 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 95/195] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:52 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:52.756671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1908bff-a45c-48b2-81b1-6e0f2b05148a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:52.773961 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e1908bff-a45c-48b2-81b1-6e0f2b05148a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.360836 Sep 08 13:53:52.792236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 101/196] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:52 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:53.511204 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e19e032d-6f7e-40fe-b878-d5f5c77223d4 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:53.513410 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e19e032d-6f7e-40fe-b878-d5f5c77223d4 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:53.526577 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19e032d-6f7e-40fe-b878-d5f5c77223d4 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:53.527190 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19e032d-6f7e-40fe-b878-d5f5c77223d4 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:53.530785 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19e032d-6f7e-40fe-b878-d5f5c77223d4 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:53.531694 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19e032d-6f7e-40fe-b878-d5f5c77223d4 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:53.533425 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19e032d-6f7e-40fe-b878-d5f5c77223d4 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:53.534075 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e19e032d-6f7e-40fe-b878-d5f5c77223d4 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:53.730812 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e19e032d-6f7e-40fe-b878-d5f5c77223d4 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:53.739026 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e19e032d-6f7e-40fe-b878-d5f5c77223d4 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.233818 Sep 08 13:53:53.740451 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 96/197] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:53 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:53.818641 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e3883104-1b9c-49fa-b845-4b5a3e8ed560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:53.820300 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e3883104-1b9c-49fa-b845-4b5a3e8ed560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:53.830157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:53.830882 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:53.845534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3883104-1b9c-49fa-b845-4b5a3e8ed560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:53.846231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:53.846944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:53.847618 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3883104-1b9c-49fa-b845-4b5a3e8ed560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:53.848255 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:53.849244 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:53.849842 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3883104-1b9c-49fa-b845-4b5a3e8ed560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:53.850618 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3883104-1b9c-49fa-b845-4b5a3e8ed560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:53.851137 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:53.851725 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3883104-1b9c-49fa-b845-4b5a3e8ed560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:53.852360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:53.852964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3883104-1b9c-49fa-b845-4b5a3e8ed560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:53.887288 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] HTTP exception thrown: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Request method failure captured: Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e HTTP/1.1 Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOkIrUCcYmotY3QkUNr_-Qqum3R-gHr7fX1nFty1kgRUfkh0GJHRUp4LoBrWeETJ6nuXMUG5mGufJuCk4IGSY6llURVwGhn8yk-4lrEuGBXTVq40GPvh_V8E5qSEQux6oEvlYza9nJTd2jQO3Q90XByEWsk_-KF1jS7trQoEmvM41M Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: b868b7f8289047369b2fcbb500f353e5 Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:53:53.894000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b868b7f8289047369b2fcbb500f353e5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: b868b7f8289047369b2fcbb500f353e5 Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-DeleteServersTestJSON-1637109358-project Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 55d8e06905644ac39777328db72526ca Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-DeleteServersTestJSON-1637109358-project Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:53.895538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '3a4e6c3b-d230-477f-b406-5f55ec596b1e'} Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:53:53.896363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:53.897697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:53:53.899110 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Returning 404 to user: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:53:53.900168 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-50a57b8a-22ea-47c1-aec4-b9410b05ae3d tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 404 len: 111 microversion: 2.1 time: 0.074486 Sep 08 13:53:53.901134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 97/198] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:53:53 2022] DELETE /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:53:53.912280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:53.913576 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] [instance: 3a4e6c3b-d230-477f-b406-5f55ec596b1e] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:53.923588 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:53.924828 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:53.925503 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:53.926855 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:53.927524 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:53.928379 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:53.950475 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] HTTP exception thrown: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Request method failure captured: Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e HTTP/1.1 Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOkIrUCcYmotY3QkUNr_-Qqum3R-gHr7fX1nFty1kgRUfkh0GJHRUp4LoBrWeETJ6nuXMUG5mGufJuCk4IGSY6llURVwGhn8yk-4lrEuGBXTVq40GPvh_V8E5qSEQux6oEvlYza9nJTd2jQO3Q90XByEWsk_-KF1jS7trQoEmvM41M Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: b868b7f8289047369b2fcbb500f353e5 Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:53:53.955867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b868b7f8289047369b2fcbb500f353e5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b868b7f8289047369b2fcbb500f353e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: b868b7f8289047369b2fcbb500f353e5 Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1637109358 Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-DeleteServersTestJSON-1637109358-project Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 55d8e06905644ac39777328db72526ca Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-DeleteServersTestJSON-1637109358-project Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:53.957360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '3a4e6c3b-d230-477f-b406-5f55ec596b1e'} Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:53:53.958170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. Sep 08 13:53:53.959264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:53:53.960959 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] Returning 404 to user: Instance 3a4e6c3b-d230-477f-b406-5f55ec596b1e could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:53:53.962262 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0be9b534-84b3-4045-b850-3fb1068a8d2e tempest-DeleteServersTestJSON-1637109358 tempest-DeleteServersTestJSON-1637109358-project] 10.222.0.55 "GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e" status: 404 len: 111 microversion: 2.1 time: 0.055310 Sep 08 13:53:53.963268 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 98/199] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:53 2022] GET /compute/v2.1/servers/3a4e6c3b-d230-477f-b406-5f55ec596b1e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:53:54.099419 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e3883104-1b9c-49fa-b845-4b5a3e8ed560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:54.108313 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e3883104-1b9c-49fa-b845-4b5a3e8ed560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.293186 Sep 08 13:53:54.109473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 102/200] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:53 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:54.764831 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-edd31db4-adc9-405a-99b4-89c06da47561 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:54.766252 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-edd31db4-adc9-405a-99b4-89c06da47561 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:54.774734 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd31db4-adc9-405a-99b4-89c06da47561 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:54.777043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd31db4-adc9-405a-99b4-89c06da47561 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:54.777492 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd31db4-adc9-405a-99b4-89c06da47561 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:54.778238 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd31db4-adc9-405a-99b4-89c06da47561 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:54.778703 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd31db4-adc9-405a-99b4-89c06da47561 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:54.779125 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-edd31db4-adc9-405a-99b4-89c06da47561 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:55.042252 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-edd31db4-adc9-405a-99b4-89c06da47561 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:55.055860 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-edd31db4-adc9-405a-99b4-89c06da47561 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.297185 Sep 08 13:53:55.074461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 99/201] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:54 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:55.135552 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33da9dca-2b48-45e5-8033-3ea93d62e745 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:55.137389 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33da9dca-2b48-45e5-8033-3ea93d62e745 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:55.148776 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33da9dca-2b48-45e5-8033-3ea93d62e745 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:55.150434 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33da9dca-2b48-45e5-8033-3ea93d62e745 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:55.152233 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33da9dca-2b48-45e5-8033-3ea93d62e745 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:55.154223 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33da9dca-2b48-45e5-8033-3ea93d62e745 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:55.158836 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33da9dca-2b48-45e5-8033-3ea93d62e745 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:55.161151 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33da9dca-2b48-45e5-8033-3ea93d62e745 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:55.405714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-33da9dca-2b48-45e5-8033-3ea93d62e745 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:55.434791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33da9dca-2b48-45e5-8033-3ea93d62e745 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.303116 Sep 08 13:53:55.456117 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 103/202] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:55 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:56.081518 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-303d708f-cfe3-453e-bc29-942f5bb5831e tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:56.083282 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-303d708f-cfe3-453e-bc29-942f5bb5831e tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:56.095109 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-303d708f-cfe3-453e-bc29-942f5bb5831e tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:56.100460 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-303d708f-cfe3-453e-bc29-942f5bb5831e tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:56.101912 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-303d708f-cfe3-453e-bc29-942f5bb5831e tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:56.103191 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-303d708f-cfe3-453e-bc29-942f5bb5831e tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:56.105681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-303d708f-cfe3-453e-bc29-942f5bb5831e tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:56.106701 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-303d708f-cfe3-453e-bc29-942f5bb5831e tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:56.313968 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-303d708f-cfe3-453e-bc29-942f5bb5831e tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:56.321941 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-303d708f-cfe3-453e-bc29-942f5bb5831e tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1315 microversion: 2.1 time: 0.245251 Sep 08 13:53:56.324184 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 100/203] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:56 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:56.461991 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5973b026-73df-4656-b13b-d59509f9dfe2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:56.462613 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5973b026-73df-4656-b13b-d59509f9dfe2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:56.470211 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5973b026-73df-4656-b13b-d59509f9dfe2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:56.470702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5973b026-73df-4656-b13b-d59509f9dfe2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:56.471445 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5973b026-73df-4656-b13b-d59509f9dfe2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:56.472611 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5973b026-73df-4656-b13b-d59509f9dfe2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:56.473253 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5973b026-73df-4656-b13b-d59509f9dfe2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:56.473938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5973b026-73df-4656-b13b-d59509f9dfe2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:56.741314 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5973b026-73df-4656-b13b-d59509f9dfe2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:56.750879 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5973b026-73df-4656-b13b-d59509f9dfe2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.292884 Sep 08 13:53:56.751436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 104/204] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:56 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:57.355766 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-45ef6c2f-f764-4c2a-b71a-9d6d7eecfcbe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:57.357358 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-45ef6c2f-f764-4c2a-b71a-9d6d7eecfcbe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:57.367671 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ef6c2f-f764-4c2a-b71a-9d6d7eecfcbe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:57.368940 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ef6c2f-f764-4c2a-b71a-9d6d7eecfcbe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:57.371562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ef6c2f-f764-4c2a-b71a-9d6d7eecfcbe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:57.376346 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ef6c2f-f764-4c2a-b71a-9d6d7eecfcbe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:57.377101 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ef6c2f-f764-4c2a-b71a-9d6d7eecfcbe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:57.377619 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-45ef6c2f-f764-4c2a-b71a-9d6d7eecfcbe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:57.608268 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-45ef6c2f-f764-4c2a-b71a-9d6d7eecfcbe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:57.616719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-45ef6c2f-f764-4c2a-b71a-9d6d7eecfcbe tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1465 microversion: 2.1 time: 0.267246 Sep 08 13:53:57.617992 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 101/205] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:57 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1465 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:57.676573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c94fa2bb-8dd2-49af-a38b-e13de57b45a3 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:57.677137 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c94fa2bb-8dd2-49af-a38b-e13de57b45a3 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:57.693194 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c94fa2bb-8dd2-49af-a38b-e13de57b45a3 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:57.693705 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c94fa2bb-8dd2-49af-a38b-e13de57b45a3 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:57.703319 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c94fa2bb-8dd2-49af-a38b-e13de57b45a3 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:57.704123 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c94fa2bb-8dd2-49af-a38b-e13de57b45a3 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:57.704605 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c94fa2bb-8dd2-49af-a38b-e13de57b45a3 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:57.705028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c94fa2bb-8dd2-49af-a38b-e13de57b45a3 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:57.777041 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c94fa2bb-8dd2-49af-a38b-e13de57b45a3 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:53:57.786475 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c17dff8-682f-4102-aa91-347c49bc0970 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:57.792570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c17dff8-682f-4102-aa91-347c49bc0970 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:57.830813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c17dff8-682f-4102-aa91-347c49bc0970 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:57.834413 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c17dff8-682f-4102-aa91-347c49bc0970 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:57.839741 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c17dff8-682f-4102-aa91-347c49bc0970 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:57.840727 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c17dff8-682f-4102-aa91-347c49bc0970 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:57.841336 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c17dff8-682f-4102-aa91-347c49bc0970 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:57.842571 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c17dff8-682f-4102-aa91-347c49bc0970 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:58.048298 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c94fa2bb-8dd2-49af-a38b-e13de57b45a3 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "DELETE /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 204 len: 0 microversion: 2.1 time: 0.374257 Sep 08 13:53:58.062247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 105/206] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:53:57 2022] DELETE /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:53:58.076677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e78f07b-3ef8-465a-8e63-920feec9a6c6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:58.077368 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e78f07b-3ef8-465a-8e63-920feec9a6c6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:58.096142 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e78f07b-3ef8-465a-8e63-920feec9a6c6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:58.096833 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e78f07b-3ef8-465a-8e63-920feec9a6c6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:58.097466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e78f07b-3ef8-465a-8e63-920feec9a6c6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:58.098474 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e78f07b-3ef8-465a-8e63-920feec9a6c6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:58.099071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e78f07b-3ef8-465a-8e63-920feec9a6c6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:58.100364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e78f07b-3ef8-465a-8e63-920feec9a6c6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:58.329157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c17dff8-682f-4102-aa91-347c49bc0970 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:58.341490 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c17dff8-682f-4102-aa91-347c49bc0970 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.569444 Sep 08 13:53:58.357560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 102/207] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:57 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:58.411955 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e78f07b-3ef8-465a-8e63-920feec9a6c6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:58.423351 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e78f07b-3ef8-465a-8e63-920feec9a6c6 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1471 microversion: 2.1 time: 0.354805 Sep 08 13:53:58.425354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 106/208] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:58 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1471 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:59.364769 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd6c8fbf-e084-476f-b1a1-028a76652d62 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:59.365394 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd6c8fbf-e084-476f-b1a1-028a76652d62 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:59.379530 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6c8fbf-e084-476f-b1a1-028a76652d62 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:59.387397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6c8fbf-e084-476f-b1a1-028a76652d62 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:59.388322 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6c8fbf-e084-476f-b1a1-028a76652d62 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:59.389313 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6c8fbf-e084-476f-b1a1-028a76652d62 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:59.390051 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6c8fbf-e084-476f-b1a1-028a76652d62 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:59.390694 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd6c8fbf-e084-476f-b1a1-028a76652d62 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:59.450749 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-04b06626-d1e6-4090-bded-4eccd9fa5206 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:59.451397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-04b06626-d1e6-4090-bded-4eccd9fa5206 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:59.471158 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04b06626-d1e6-4090-bded-4eccd9fa5206 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:59.471740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04b06626-d1e6-4090-bded-4eccd9fa5206 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:59.472502 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04b06626-d1e6-4090-bded-4eccd9fa5206 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:59.473480 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04b06626-d1e6-4090-bded-4eccd9fa5206 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:59.474102 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04b06626-d1e6-4090-bded-4eccd9fa5206 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:59.474690 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04b06626-d1e6-4090-bded-4eccd9fa5206 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:59.611728 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd6c8fbf-e084-476f-b1a1-028a76652d62 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:59.621098 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd6c8fbf-e084-476f-b1a1-028a76652d62 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.260290 Sep 08 13:53:59.625580 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 103/209] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:59 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:59.710573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-04b06626-d1e6-4090-bded-4eccd9fa5206 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:59.724854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-04b06626-d1e6-4090-bded-4eccd9fa5206 tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1471 microversion: 2.1 time: 0.278645 Sep 08 13:53:59.725980 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 107/210] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:59 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:00.651960 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0647d415-c184-43f9-b28c-625d27031cb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:00.654007 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0647d415-c184-43f9-b28c-625d27031cb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:00.663979 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0647d415-c184-43f9-b28c-625d27031cb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:00.664721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0647d415-c184-43f9-b28c-625d27031cb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:00.665470 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0647d415-c184-43f9-b28c-625d27031cb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:00.666704 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0647d415-c184-43f9-b28c-625d27031cb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:00.667470 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0647d415-c184-43f9-b28c-625d27031cb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:00.668184 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0647d415-c184-43f9-b28c-625d27031cb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:00.749345 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-687bb75c-2d96-4a34-a74d-25132390aeec tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:00.750127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-687bb75c-2d96-4a34-a74d-25132390aeec tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:00.760310 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-687bb75c-2d96-4a34-a74d-25132390aeec tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:00.762204 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-687bb75c-2d96-4a34-a74d-25132390aeec tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:00.764851 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-687bb75c-2d96-4a34-a74d-25132390aeec tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:00.765807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-687bb75c-2d96-4a34-a74d-25132390aeec tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:00.770628 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-687bb75c-2d96-4a34-a74d-25132390aeec tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:00.773869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-687bb75c-2d96-4a34-a74d-25132390aeec tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:01.085633 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0647d415-c184-43f9-b28c-625d27031cb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:01.100771 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0647d415-c184-43f9-b28c-625d27031cb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.456153 Sep 08 13:54:01.114636 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 104/211] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:00 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:01.115958 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-687bb75c-2d96-4a34-a74d-25132390aeec tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:01.136487 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-687bb75c-2d96-4a34-a74d-25132390aeec tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1471 microversion: 2.1 time: 0.391593 Sep 08 13:54:01.148737 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 108/212] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:00 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1471 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:01.272177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e6bdf05d-666a-4a19-ba6e-f55d77c618ff tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Action: 'create', calling method: .version_select at 0x7f5be45b35e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-789751874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrVJCxEpswKfTbtZ2oSWBrX4ls8q44EfBvjph+jT3BKsZYb7vvjtzuRS2+a9BrjTNWGRpyYalwVzDPyitmoNet2aVUa1bEQWrruzdaGoaX0HblkxO+nGMFoPo1ehSae+Q=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:01.292415 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-e6bdf05d-666a-4a19-ba6e-f55d77c618ff tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Getting quotas for project f7507a7da3bb4420abcfcf08780dc0a4. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:54:01.294367 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-e6bdf05d-666a-4a19-ba6e-f55d77c618ff tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Getting quotas for user bed19e9a74be46b5bc836c3cd605133f and project f7507a7da3bb4420abcfcf08780dc0a4. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:54:01.323005 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e6bdf05d-666a-4a19-ba6e-f55d77c618ff tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054777 Sep 08 13:54:01.323864 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 105/213] 10.222.0.55 () {60 vars in 1159 bytes} [Thu Sep 8 13:54:01 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:01.403708 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-99d68086-46e8-4162-9c71-eb9401ad1f84 req-9aa720e4-db58-48b4-afce-8bb2641aafb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143f215b-f987-440e-afa1-d699e0a52772", "name": "network-vif-deleted", "tag": "2242daf3-b604-43fa-82a6-ac2fe5188b1d"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:01.431404 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-99d68086-46e8-4162-9c71-eb9401ad1f84 req-9aa720e4-db58-48b4-afce-8bb2641aafb5 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:01.432058 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-99d68086-46e8-4162-9c71-eb9401ad1f84 req-9aa720e4-db58-48b4-afce-8bb2641aafb5 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:01.436800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-99d68086-46e8-4162-9c71-eb9401ad1f84 req-9aa720e4-db58-48b4-afce-8bb2641aafb5 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:01.469456 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-99d68086-46e8-4162-9c71-eb9401ad1f84 req-9aa720e4-db58-48b4-afce-8bb2641aafb5 service nova] Creating event network-vif-deleted:2242daf3-b604-43fa-82a6-ac2fe5188b1d for instance 143f215b-f987-440e-afa1-d699e0a52772 on hv-cinder-82002 Sep 08 13:54:01.490217 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-99d68086-46e8-4162-9c71-eb9401ad1f84 req-9aa720e4-db58-48b4-afce-8bb2641aafb5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089132 Sep 08 13:54:01.494152 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 109/214] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:01.589553 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-787443163", "imageRef": "67420a30-4abc-4ce8-b39e-3c9bbcf1b821", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-789751874", "networks": [{"uuid": "2484c1b8-1d7e-43af-960e-e27892a8e9d6"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:01.663623 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] validate_networks() for [('2484c1b8-1d7e-43af-960e-e27892a8e9d6', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:54:02.127137 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d17eb5c9-2a1b-465e-9571-a15b15096853 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:02.127847 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d17eb5c9-2a1b-465e-9571-a15b15096853 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:02.129829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:54:02.130248 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:54:02.130714 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:54:02.131151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:54:02.131976 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:54:02.141024 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d17eb5c9-2a1b-465e-9571-a15b15096853 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:02.142206 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d17eb5c9-2a1b-465e-9571-a15b15096853 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:02.142833 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d17eb5c9-2a1b-465e-9571-a15b15096853 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:02.143455 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:02.144309 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:02.144454 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d17eb5c9-2a1b-465e-9571-a15b15096853 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:02.145103 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:02.145575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d17eb5c9-2a1b-465e-9571-a15b15096853 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:02.146221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d17eb5c9-2a1b-465e-9571-a15b15096853 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:02.146681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:02.147298 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:02.147823 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:02.169369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Getting quotas for project f7507a7da3bb4420abcfcf08780dc0a4. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:54:02.175408 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Getting quotas for user bed19e9a74be46b5bc836c3cd605133f and project f7507a7da3bb4420abcfcf08780dc0a4. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:54:02.190179 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:54:02.194618 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='67420a30-4abc-4ce8-b39e-3c9bbcf1b821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:54:02.306453 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40e85aa5-d035-4a55-b2f6-b9a9637a7fbc tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725198 Sep 08 13:54:02.308332 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 106/215] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:54:02.313662 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:02.314809 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:02.317820 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:02.331957 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:02.332709 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:02.333494 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:02.334593 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:02.335205 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:02.335960 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:02.341427 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d17eb5c9-2a1b-465e-9571-a15b15096853 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:02.367438 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d17eb5c9-2a1b-465e-9571-a15b15096853 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.245460 Sep 08 13:54:02.368253 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 110/216] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:02 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:02.378391 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0bf387dd-e291-4f38-afec-d06668fab816 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:02.379337 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0bf387dd-e291-4f38-afec-d06668fab816 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:02.392534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:02.394656 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:02.395297 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:02.396712 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lazy-loading 'fault' on Instance uuid 143f215b-f987-440e-afa1-d699e0a52772 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:54:02.475000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60401b675bb4dff9ebc12b6076fdd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929ea6da40417394a9274b2c86c96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:02.483600 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7ecf58a4-5521-4421-9368-02ff1d2f48dd tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 200 len: 1305 microversion: 2.1 time: 0.173970 Sep 08 13:54:02.484480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 107/217] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:02 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 1305 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:02.525424 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0bf387dd-e291-4f38-afec-d06668fab816 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:02.534245 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0bf387dd-e291-4f38-afec-d06668fab816 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1257 microversion: 2.1 time: 0.163148 Sep 08 13:54:02.550539 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 111/218] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:02 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1257 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:03.405693 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-65511307-e0df-4eee-bf77-a674638c9453 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:03.406412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65511307-e0df-4eee-bf77-a674638c9453 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:03.424471 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65511307-e0df-4eee-bf77-a674638c9453 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:03.424971 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65511307-e0df-4eee-bf77-a674638c9453 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:03.428533 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65511307-e0df-4eee-bf77-a674638c9453 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:03.431080 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65511307-e0df-4eee-bf77-a674638c9453 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:03.431554 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65511307-e0df-4eee-bf77-a674638c9453 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:03.433643 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65511307-e0df-4eee-bf77-a674638c9453 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:03.520049 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:03.525417 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] [instance: 143f215b-f987-440e-afa1-d699e0a52772] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:03.530459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:03.544338 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:03.545779 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:03.546565 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:03.547700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:03.548043 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:03.548519 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:03.580153 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] HTTP exception thrown: Instance 143f215b-f987-440e-afa1-d699e0a52772 could not be found. Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Request method failure captured: Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 HTTP/1.1 Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfPav-20hwcGFF1E4PUL5E29Z4IzxLP-EBgPZMS4fdNi5f2OXrZB1c-zghucqShmXSVEUWYklZAwpa6QA6fjyPdwCUsZM4Oa9Pc8S_KTI3PptyNgmFguDH7q4X-gWvuQKosYpGIk3Jef4mv2naaulLsf5VDRB2F8MAdWEnz5x4isr9s Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 06929ea6da40417394a9274b2c86c96a Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesNegativeTest-1693092154 Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:54:03.582397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_06929ea6da40417394a9274b2c86c96a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/06929ea6da40417394a9274b2c86c96a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/06929ea6da40417394a9274b2c86c96a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/06929ea6da40417394a9274b2c86c96a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-VolumesNegativeTest-1693092154 Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 06929ea6da40417394a9274b2c86c96a Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesNegativeTest-1693092154 Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-VolumesNegativeTest-1693092154-project Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: e60401b675bb4dff9ebc12b6076fdd3f Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-VolumesNegativeTest-1693092154-project Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 143f215b-f987-440e-afa1-d699e0a52772 could not be found. Sep 08 13:54:03.583778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '143f215b-f987-440e-afa1-d699e0a52772'} Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143f215b-f987-440e-afa1-d699e0a52772 could not be found. Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:54:03.584496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143f215b-f987-440e-afa1-d699e0a52772 could not be found. Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143f215b-f987-440e-afa1-d699e0a52772 could not be found. Sep 08 13:54:03.589562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:54:03.590680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] Returning 404 to user: Instance 143f215b-f987-440e-afa1-d699e0a52772 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:54:03.590680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a953290-4537-47d5-9449-a41b648ae8fa tempest-VolumesNegativeTest-1693092154 tempest-VolumesNegativeTest-1693092154-project] 10.222.0.55 "GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772" status: 404 len: 111 microversion: 2.1 time: 0.076953 Sep 08 13:54:03.590680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 112/219] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:03 2022] GET /compute/v2.1/servers/143f215b-f987-440e-afa1-d699e0a52772 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:54:03.590680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65507cb0-814c-4622-a1d8-f44df35e3ff0 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:03.591152 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65507cb0-814c-4622-a1d8-f44df35e3ff0 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:03.610832 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65507cb0-814c-4622-a1d8-f44df35e3ff0 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:03.611651 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65507cb0-814c-4622-a1d8-f44df35e3ff0 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:03.613140 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65507cb0-814c-4622-a1d8-f44df35e3ff0 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:03.613883 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65507cb0-814c-4622-a1d8-f44df35e3ff0 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:03.614411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65507cb0-814c-4622-a1d8-f44df35e3ff0 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:03.616492 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65507cb0-814c-4622-a1d8-f44df35e3ff0 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:04.131339 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-65507cb0-814c-4622-a1d8-f44df35e3ff0 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:04.142856 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65507cb0-814c-4622-a1d8-f44df35e3ff0 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1309 microversion: 2.1 time: 0.555961 Sep 08 13:54:04.157775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 113/220] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:03 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1309 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:04.255521 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-65511307-e0df-4eee-bf77-a674638c9453 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:04.259038 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:04.265080 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-65511307-e0df-4eee-bf77-a674638c9453 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.874302 Sep 08 13:54:04.266254 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 108/221] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:03 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:05.168875 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3dbab210-271e-450e-8d49-c29d59899b03 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:05.169510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3dbab210-271e-450e-8d49-c29d59899b03 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:05.186627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbab210-271e-450e-8d49-c29d59899b03 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:05.187165 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbab210-271e-450e-8d49-c29d59899b03 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:05.189320 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbab210-271e-450e-8d49-c29d59899b03 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:05.194523 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbab210-271e-450e-8d49-c29d59899b03 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:05.194956 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbab210-271e-450e-8d49-c29d59899b03 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:05.195390 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dbab210-271e-450e-8d49-c29d59899b03 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:05.289489 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-924df0b6-4be4-4ad7-9e1b-c20d17b0bc15 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:05.290419 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-924df0b6-4be4-4ad7-9e1b-c20d17b0bc15 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:05.304009 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-924df0b6-4be4-4ad7-9e1b-c20d17b0bc15 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:05.306509 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-924df0b6-4be4-4ad7-9e1b-c20d17b0bc15 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:05.307137 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-924df0b6-4be4-4ad7-9e1b-c20d17b0bc15 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:05.310003 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-924df0b6-4be4-4ad7-9e1b-c20d17b0bc15 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:05.311637 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-924df0b6-4be4-4ad7-9e1b-c20d17b0bc15 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:05.312797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-924df0b6-4be4-4ad7-9e1b-c20d17b0bc15 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:05.483242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3dbab210-271e-450e-8d49-c29d59899b03 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:05.498905 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3dbab210-271e-450e-8d49-c29d59899b03 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1315 microversion: 2.1 time: 0.333785 Sep 08 13:54:05.509150 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 114/222] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:05 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:05.802549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-924df0b6-4be4-4ad7-9e1b-c20d17b0bc15 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:05.811377 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-924df0b6-4be4-4ad7-9e1b-c20d17b0bc15 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.525535 Sep 08 13:54:05.825564 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 109/223] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:05 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:06.536910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad9e14ae-3ad4-4da6-ac60-d5d8bf6ad0af tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:06.538757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad9e14ae-3ad4-4da6-ac60-d5d8bf6ad0af tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:06.564676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9e14ae-3ad4-4da6-ac60-d5d8bf6ad0af tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:06.565244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9e14ae-3ad4-4da6-ac60-d5d8bf6ad0af tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:06.565672 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9e14ae-3ad4-4da6-ac60-d5d8bf6ad0af tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:06.578083 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9e14ae-3ad4-4da6-ac60-d5d8bf6ad0af tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:06.580104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9e14ae-3ad4-4da6-ac60-d5d8bf6ad0af tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:06.585632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad9e14ae-3ad4-4da6-ac60-d5d8bf6ad0af tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:06.875278 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e111822e-2472-4917-adfe-05bf6d3236cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:06.875998 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e111822e-2472-4917-adfe-05bf6d3236cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:06.887631 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e111822e-2472-4917-adfe-05bf6d3236cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:06.890795 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e111822e-2472-4917-adfe-05bf6d3236cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:06.891322 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e111822e-2472-4917-adfe-05bf6d3236cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:06.898698 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e111822e-2472-4917-adfe-05bf6d3236cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:06.905542 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e111822e-2472-4917-adfe-05bf6d3236cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:06.906327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e111822e-2472-4917-adfe-05bf6d3236cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:07.850735 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ad9e14ae-3ad4-4da6-ac60-d5d8bf6ad0af tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:07.864830 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad9e14ae-3ad4-4da6-ac60-d5d8bf6ad0af tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 1.337188 Sep 08 13:54:07.883083 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 115/224] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:06 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:07.920294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e111822e-2472-4917-adfe-05bf6d3236cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:07.930437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e111822e-2472-4917-adfe-05bf6d3236cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 1.059256 Sep 08 13:54:07.936233 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 110/225] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:06 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:08.924477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0ba82c7f-0149-416b-be60-712a45bbf0c2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:08.926311 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0ba82c7f-0149-416b-be60-712a45bbf0c2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:08.933644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba82c7f-0149-416b-be60-712a45bbf0c2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:08.934321 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba82c7f-0149-416b-be60-712a45bbf0c2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:08.935342 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba82c7f-0149-416b-be60-712a45bbf0c2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:08.936244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba82c7f-0149-416b-be60-712a45bbf0c2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:08.936833 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba82c7f-0149-416b-be60-712a45bbf0c2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:08.937557 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0ba82c7f-0149-416b-be60-712a45bbf0c2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:08.957132 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-da094fe7-ce5e-47b4-9310-7b01962efdff tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:08.958789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-da094fe7-ce5e-47b4-9310-7b01962efdff tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:08.970675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da094fe7-ce5e-47b4-9310-7b01962efdff tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:08.971573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da094fe7-ce5e-47b4-9310-7b01962efdff tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:08.972170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da094fe7-ce5e-47b4-9310-7b01962efdff tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:08.974601 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da094fe7-ce5e-47b4-9310-7b01962efdff tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:08.975274 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da094fe7-ce5e-47b4-9310-7b01962efdff tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:08.975848 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-da094fe7-ce5e-47b4-9310-7b01962efdff tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:08.993862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:09.662448 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-da094fe7-ce5e-47b4-9310-7b01962efdff tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:09.673133 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-da094fe7-ce5e-47b4-9310-7b01962efdff tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.719948 Sep 08 13:54:09.697702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0ba82c7f-0149-416b-be60-712a45bbf0c2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:09.700649 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 111/226] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:08 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:09.708717 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0ba82c7f-0149-416b-be60-712a45bbf0c2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.793304 Sep 08 13:54:09.724113 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 116/227] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:08 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:10.007754 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-559046397", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "networks": [{"uuid": "27a47ec4-fdfa-4d05-bf7d-7362b88969c5"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:10.149541 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] validate_networks() for [('27a47ec4-fdfa-4d05-bf7d-7362b88969c5', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:54:10.703770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ed63c424-5985-4a4e-a212-072923368ac7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:10.704376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ed63c424-5985-4a4e-a212-072923368ac7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:10.719534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed63c424-5985-4a4e-a212-072923368ac7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:10.722944 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed63c424-5985-4a4e-a212-072923368ac7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:10.723467 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed63c424-5985-4a4e-a212-072923368ac7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:10.727290 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed63c424-5985-4a4e-a212-072923368ac7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:10.729554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed63c424-5985-4a4e-a212-072923368ac7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:10.730244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed63c424-5985-4a4e-a212-072923368ac7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:11.458986 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ed63c424-5985-4a4e-a212-072923368ac7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:11.469621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ed63c424-5985-4a4e-a212-072923368ac7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.769693 Sep 08 13:54:11.486047 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 117/228] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:10 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:11.504305 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e5bc9b5c-2d70-4ff9-9ce1-d61151b34369 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:11.504928 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e5bc9b5c-2d70-4ff9-9ce1-d61151b34369 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:11.525626 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5bc9b5c-2d70-4ff9-9ce1-d61151b34369 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:11.528328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5bc9b5c-2d70-4ff9-9ce1-d61151b34369 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:11.531121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5bc9b5c-2d70-4ff9-9ce1-d61151b34369 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:11.534713 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5bc9b5c-2d70-4ff9-9ce1-d61151b34369 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:11.535371 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5bc9b5c-2d70-4ff9-9ce1-d61151b34369 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:11.537781 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e5bc9b5c-2d70-4ff9-9ce1-d61151b34369 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:12.158763 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:12.184759 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=10 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:12.449385 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e5bc9b5c-2d70-4ff9-9ce1-d61151b34369 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:12.459381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e5bc9b5c-2d70-4ff9-9ce1-d61151b34369 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.973171 Sep 08 13:54:12.465553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 118/229] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:11 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:12.478494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e0158d22-3a9f-44e8-a750-806d6611f8bb req-0428c8dd-c618-43da-8c16-e4a885604f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e64a0c9-b7b0-46ff-8526-88164d493140", "tag": "ca4283b0-e159-4a24-b0b2-bc113ff78694"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:12.510606 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e0158d22-3a9f-44e8-a750-806d6611f8bb req-0428c8dd-c618-43da-8c16-e4a885604f0c service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:12.511217 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e0158d22-3a9f-44e8-a750-806d6611f8bb req-0428c8dd-c618-43da-8c16-e4a885604f0c service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:12.511644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e0158d22-3a9f-44e8-a750-806d6611f8bb req-0428c8dd-c618-43da-8c16-e4a885604f0c service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:12.542797 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:12.557395 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e0158d22-3a9f-44e8-a750-806d6611f8bb req-0428c8dd-c618-43da-8c16-e4a885604f0c service nova] Creating event network-changed:ca4283b0-e159-4a24-b0b2-bc113ff78694 for instance 6e64a0c9-b7b0-46ff-8526-88164d493140 on hv-cinder-82002 Sep 08 13:54:12.564097 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e0158d22-3a9f-44e8-a750-806d6611f8bb req-0428c8dd-c618-43da-8c16-e4a885604f0c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097235 Sep 08 13:54:12.569984 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 119/230] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:12.577408 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9f5ec5a5-bb41-422f-bbb9-5f07eb8a49c8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:12.578129 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9f5ec5a5-bb41-422f-bbb9-5f07eb8a49c8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:12.605681 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f5ec5a5-bb41-422f-bbb9-5f07eb8a49c8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:12.608342 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f5ec5a5-bb41-422f-bbb9-5f07eb8a49c8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:12.609149 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f5ec5a5-bb41-422f-bbb9-5f07eb8a49c8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:12.610546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f5ec5a5-bb41-422f-bbb9-5f07eb8a49c8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:12.611203 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f5ec5a5-bb41-422f-bbb9-5f07eb8a49c8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:12.611926 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f5ec5a5-bb41-422f-bbb9-5f07eb8a49c8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:12.617210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:54:12.617991 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:54:12.618671 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:54:12.619308 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:54:12.620668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:54:12.632200 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:12.634051 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:12.635382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:12.637541 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:12.639265 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:12.640263 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:12.698768 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Getting quotas for project 0375e7ef3fb04600b5d4095057658bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:54:12.710105 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Getting quotas for user e93b5304ecec4ceca33da4b58e8e2480 and project 0375e7ef3fb04600b5d4095057658bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:54:12.774271 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:54:12.792070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:54:12.894036 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f4eeb63-a608-4e09-acbb-887d9f45b309 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.890557 Sep 08 13:54:12.901820 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 112/231] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:54:12.913336 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-03edd59c-4b63-4fb1-a32d-fda8ead7cd2f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:12.918285 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-03edd59c-4b63-4fb1-a32d-fda8ead7cd2f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:13.055020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-03edd59c-4b63-4fb1-a32d-fda8ead7cd2f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:13.085523 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-03edd59c-4b63-4fb1-a32d-fda8ead7cd2f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1218 microversion: 2.1 time: 0.172592 Sep 08 13:54:13.086211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 113/232] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:12 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:13.143704 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9f5ec5a5-bb41-422f-bbb9-5f07eb8a49c8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:13.158346 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9f5ec5a5-bb41-422f-bbb9-5f07eb8a49c8 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.586982 Sep 08 13:54:13.159483 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 120/233] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:12 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:13.485843 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-981dcbb6-f426-468f-b13d-d14d7c4eb588 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:13.486489 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-981dcbb6-f426-468f-b13d-d14d7c4eb588 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:13.516990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-981dcbb6-f426-468f-b13d-d14d7c4eb588 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:13.517497 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-981dcbb6-f426-468f-b13d-d14d7c4eb588 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:13.521784 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-981dcbb6-f426-468f-b13d-d14d7c4eb588 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:13.525147 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-981dcbb6-f426-468f-b13d-d14d7c4eb588 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:13.527570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-981dcbb6-f426-468f-b13d-d14d7c4eb588 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:13.531328 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-981dcbb6-f426-468f-b13d-d14d7c4eb588 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:13.863266 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-981dcbb6-f426-468f-b13d-d14d7c4eb588 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:13.877621 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-981dcbb6-f426-468f-b13d-d14d7c4eb588 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.396995 Sep 08 13:54:13.880688 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 114/234] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:13 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:14.115407 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9cdc8e56-a416-4570-a97a-e02ad199f071 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:14.116923 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9cdc8e56-a416-4570-a97a-e02ad199f071 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:14.136055 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cdc8e56-a416-4570-a97a-e02ad199f071 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:14.145031 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cdc8e56-a416-4570-a97a-e02ad199f071 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:14.145471 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cdc8e56-a416-4570-a97a-e02ad199f071 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:14.146269 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cdc8e56-a416-4570-a97a-e02ad199f071 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:14.146738 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cdc8e56-a416-4570-a97a-e02ad199f071 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:14.153349 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cdc8e56-a416-4570-a97a-e02ad199f071 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:14.189265 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b12dbb3e-deba-4074-8550-b45f19ae73a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:14.190176 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b12dbb3e-deba-4074-8550-b45f19ae73a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:14.206623 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12dbb3e-deba-4074-8550-b45f19ae73a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:14.207291 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12dbb3e-deba-4074-8550-b45f19ae73a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:14.208573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12dbb3e-deba-4074-8550-b45f19ae73a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:14.209396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12dbb3e-deba-4074-8550-b45f19ae73a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:14.213809 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12dbb3e-deba-4074-8550-b45f19ae73a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:14.214400 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b12dbb3e-deba-4074-8550-b45f19ae73a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:14.320175 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cdc8e56-a416-4570-a97a-e02ad199f071 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:14.332882 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9cdc8e56-a416-4570-a97a-e02ad199f071 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1222 microversion: 2.1 time: 0.225376 Sep 08 13:54:14.336518 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 121/235] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:14 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1222 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:14.588629 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b12dbb3e-deba-4074-8550-b45f19ae73a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:14.604560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b12dbb3e-deba-4074-8550-b45f19ae73a7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.420459 Sep 08 13:54:14.610070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 115/236] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:14 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:14.787679 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-85d4cec8-3f7b-488d-98a3-6cf1cdade4a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Action: 'create', calling method: .version_select at 0x7f5be4576550>, body: {"keypair": {"name": "tempest-keypair-749651817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLLgfKMd8XqS2VE2HmyKrUr6Iye74YXYSus+omjf8eCWtiujBxaB9DJ5CUoGVtROsCJy87fhwFdaPnthyyAXPtt5VC9H4K55Kb/9ZG/mnMQ7HhdRNrCqw2sQBZNq5q3Mw=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:14.808755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-85d4cec8-3f7b-488d-98a3-6cf1cdade4a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Getting quotas for project bc4476b1f4b84b5593ff2650592b9fb7. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:54:14.814322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-85d4cec8-3f7b-488d-98a3-6cf1cdade4a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Getting quotas for user 75642df28f5d4301b979f39482a9a11d and project bc4476b1f4b84b5593ff2650592b9fb7. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:54:14.840880 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-85d4cec8-3f7b-488d-98a3-6cf1cdade4a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.502529 Sep 08 13:54:14.842197 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 122/237] 10.222.0.55 () {62 vars in 1200 bytes} [Thu Sep 8 13:54:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 504 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 13:54:14.909123 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5c030829-7079-410a-a377-455b2163e14b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:14.910899 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5c030829-7079-410a-a377-455b2163e14b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:14.928420 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c030829-7079-410a-a377-455b2163e14b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:14.932775 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c030829-7079-410a-a377-455b2163e14b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:14.933224 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c030829-7079-410a-a377-455b2163e14b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:14.933994 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c030829-7079-410a-a377-455b2163e14b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:14.934444 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c030829-7079-410a-a377-455b2163e14b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:14.941262 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c030829-7079-410a-a377-455b2163e14b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:15.365376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb342b01-50eb-48eb-a4b2-8ddab69fdb58 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:15.366215 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb342b01-50eb-48eb-a4b2-8ddab69fdb58 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:15.371855 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5c030829-7079-410a-a377-455b2163e14b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:15.379167 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb342b01-50eb-48eb-a4b2-8ddab69fdb58 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:15.380130 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb342b01-50eb-48eb-a4b2-8ddab69fdb58 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:15.380804 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb342b01-50eb-48eb-a4b2-8ddab69fdb58 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:15.382066 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb342b01-50eb-48eb-a4b2-8ddab69fdb58 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:15.384681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5c030829-7079-410a-a377-455b2163e14b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.478479 Sep 08 13:54:15.384822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb342b01-50eb-48eb-a4b2-8ddab69fdb58 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:15.384822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb342b01-50eb-48eb-a4b2-8ddab69fdb58 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:15.385012 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 116/238] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:14 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:15.554913 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb342b01-50eb-48eb-a4b2-8ddab69fdb58 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:15.566038 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb342b01-50eb-48eb-a4b2-8ddab69fdb58 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1222 microversion: 2.1 time: 0.205424 Sep 08 13:54:15.567609 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 123/239] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:15 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1222 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:15.637701 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-426f7077-ae23-4be9-94c8-842747a9d6e5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:15.639645 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-426f7077-ae23-4be9-94c8-842747a9d6e5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:15.654947 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-426f7077-ae23-4be9-94c8-842747a9d6e5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:15.657116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-426f7077-ae23-4be9-94c8-842747a9d6e5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:15.659655 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-426f7077-ae23-4be9-94c8-842747a9d6e5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:15.660428 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-426f7077-ae23-4be9-94c8-842747a9d6e5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:15.663485 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-426f7077-ae23-4be9-94c8-842747a9d6e5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:15.665898 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-426f7077-ae23-4be9-94c8-842747a9d6e5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:15.940637 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-426f7077-ae23-4be9-94c8-842747a9d6e5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:15.951073 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-426f7077-ae23-4be9-94c8-842747a9d6e5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.317171 Sep 08 13:54:15.952224 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 117/240] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:15 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:16.407908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33c8a0ab-525c-457d-a4f2-9745f4591165 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:16.409114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33c8a0ab-525c-457d-a4f2-9745f4591165 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:16.423814 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c8a0ab-525c-457d-a4f2-9745f4591165 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:16.424479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c8a0ab-525c-457d-a4f2-9745f4591165 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:16.425070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c8a0ab-525c-457d-a4f2-9745f4591165 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:16.436925 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c8a0ab-525c-457d-a4f2-9745f4591165 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:16.440864 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c8a0ab-525c-457d-a4f2-9745f4591165 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:16.447993 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c8a0ab-525c-457d-a4f2-9745f4591165 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:16.595557 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f52649ed-9127-4b62-a7b6-b99dd5905766 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:16.596188 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f52649ed-9127-4b62-a7b6-b99dd5905766 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:16.605579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52649ed-9127-4b62-a7b6-b99dd5905766 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:16.608402 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52649ed-9127-4b62-a7b6-b99dd5905766 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:16.609653 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52649ed-9127-4b62-a7b6-b99dd5905766 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:16.612162 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52649ed-9127-4b62-a7b6-b99dd5905766 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:16.612887 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52649ed-9127-4b62-a7b6-b99dd5905766 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:16.613500 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f52649ed-9127-4b62-a7b6-b99dd5905766 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:16.771440 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f52649ed-9127-4b62-a7b6-b99dd5905766 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:16.791917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f52649ed-9127-4b62-a7b6-b99dd5905766 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1222 microversion: 2.1 time: 0.200070 Sep 08 13:54:16.794999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 118/241] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:16 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1222 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:16.996851 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3084125-a16e-492a-96e0-74a55320a6f4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:16.997458 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3084125-a16e-492a-96e0-74a55320a6f4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:17.009652 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3084125-a16e-492a-96e0-74a55320a6f4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:17.010470 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3084125-a16e-492a-96e0-74a55320a6f4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:17.014447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3084125-a16e-492a-96e0-74a55320a6f4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:17.020200 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3084125-a16e-492a-96e0-74a55320a6f4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:17.021003 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3084125-a16e-492a-96e0-74a55320a6f4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:17.021605 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3084125-a16e-492a-96e0-74a55320a6f4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:17.081773 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-33c8a0ab-525c-457d-a4f2-9745f4591165 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:17.091292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33c8a0ab-525c-457d-a4f2-9745f4591165 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.689350 Sep 08 13:54:17.106358 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 124/242] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:16 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:17.319593 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3084125-a16e-492a-96e0-74a55320a6f4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:17.337690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3084125-a16e-492a-96e0-74a55320a6f4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.360509 Sep 08 13:54:17.338881 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 119/243] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:16 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:17.828331 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7372c015-8505-437c-9239-1c79ffe2ca59 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:17.829546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7372c015-8505-437c-9239-1c79ffe2ca59 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:17.838240 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7372c015-8505-437c-9239-1c79ffe2ca59 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:17.839144 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7372c015-8505-437c-9239-1c79ffe2ca59 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:17.839918 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7372c015-8505-437c-9239-1c79ffe2ca59 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:17.843031 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7372c015-8505-437c-9239-1c79ffe2ca59 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:17.846644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7372c015-8505-437c-9239-1c79ffe2ca59 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:17.847282 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7372c015-8505-437c-9239-1c79ffe2ca59 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:17.868804 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-881355988", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c9b3d05-20f8-440e-89b3-587b430f97a5"}], "security_groups": [{"name": "tempest-securitygroup--1708742399"}], "key_name": "tempest-keypair-749651817", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:17.972222 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7372c015-8505-437c-9239-1c79ffe2ca59 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:17.990411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7372c015-8505-437c-9239-1c79ffe2ca59 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1222 microversion: 2.1 time: 0.167032 Sep 08 13:54:17.997617 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 125/244] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:17 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:18.040262 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] validate_networks() for [('1c9b3d05-20f8-440e-89b3-587b430f97a5', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:54:18.123920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1641294-f2ce-4883-bb32-fc828c1b100e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:18.124627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a1641294-f2ce-4883-bb32-fc828c1b100e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:18.132254 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1641294-f2ce-4883-bb32-fc828c1b100e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:18.133027 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1641294-f2ce-4883-bb32-fc828c1b100e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:18.133562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1641294-f2ce-4883-bb32-fc828c1b100e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:18.134306 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1641294-f2ce-4883-bb32-fc828c1b100e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:18.140290 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1641294-f2ce-4883-bb32-fc828c1b100e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:18.141049 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1641294-f2ce-4883-bb32-fc828c1b100e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:18.411314 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a1641294-f2ce-4883-bb32-fc828c1b100e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:18.419365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a1641294-f2ce-4883-bb32-fc828c1b100e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.299378 Sep 08 13:54:18.434308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 126/245] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:18 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:18.439261 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9cb3fbd7-d0ae-4fc2-9e7d-c33fabc267b3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:18.444409 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9cb3fbd7-d0ae-4fc2-9e7d-c33fabc267b3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:18.456064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb3fbd7-d0ae-4fc2-9e7d-c33fabc267b3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:18.456970 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb3fbd7-d0ae-4fc2-9e7d-c33fabc267b3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:18.458013 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb3fbd7-d0ae-4fc2-9e7d-c33fabc267b3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:18.459189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb3fbd7-d0ae-4fc2-9e7d-c33fabc267b3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:18.459952 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb3fbd7-d0ae-4fc2-9e7d-c33fabc267b3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:18.460391 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9cb3fbd7-d0ae-4fc2-9e7d-c33fabc267b3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:18.612897 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:54:18.613386 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:54:18.614001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:54:18.614481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:54:18.614960 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:54:18.626550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:18.627358 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:18.627985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:18.628922 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:18.629591 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:18.630235 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:18.647602 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Getting quotas for project bc4476b1f4b84b5593ff2650592b9fb7. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:54:18.651398 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9cb3fbd7-d0ae-4fc2-9e7d-c33fabc267b3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:18.652382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Getting quotas for user 75642df28f5d4301b979f39482a9a11d and project bc4476b1f4b84b5593ff2650592b9fb7. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:54:18.661399 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9cb3fbd7-d0ae-4fc2-9e7d-c33fabc267b3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.225953 Sep 08 13:54:18.662836 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 127/246] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:18 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:18.663916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:54:18.666171 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:54:18.732433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d80504c1-2cc4-4ed2-89a2-d47a84d03725 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.868540 Sep 08 13:54:18.733814 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 120/247] 10.222.0.55 () {62 vars in 1188 bytes} [Thu Sep 8 13:54:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 13:54:18.746090 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-59dcccce-9733-49f0-bcd6-47b449eb0ff2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:18.747045 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-59dcccce-9733-49f0-bcd6-47b449eb0ff2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:18.822987 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-59dcccce-9733-49f0-bcd6-47b449eb0ff2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:18.834025 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-59dcccce-9733-49f0-bcd6-47b449eb0ff2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:18.836000 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-59dcccce-9733-49f0-bcd6-47b449eb0ff2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:18.837389 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-59dcccce-9733-49f0-bcd6-47b449eb0ff2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1280 microversion: 2.20 time: 0.095760 Sep 08 13:54:18.839419 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 128/248] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:18 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:19.026987 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f2691768-68a6-4331-825d-b2fcfe79a3b5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:19.027592 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f2691768-68a6-4331-825d-b2fcfe79a3b5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:19.034373 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2691768-68a6-4331-825d-b2fcfe79a3b5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:19.035070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2691768-68a6-4331-825d-b2fcfe79a3b5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:19.035518 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2691768-68a6-4331-825d-b2fcfe79a3b5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:19.036226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2691768-68a6-4331-825d-b2fcfe79a3b5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:19.036649 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2691768-68a6-4331-825d-b2fcfe79a3b5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:19.037069 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2691768-68a6-4331-825d-b2fcfe79a3b5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:19.116436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f2691768-68a6-4331-825d-b2fcfe79a3b5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:19.125524 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f2691768-68a6-4331-825d-b2fcfe79a3b5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1270 microversion: 2.1 time: 0.102367 Sep 08 13:54:19.126587 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 121/249] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:19 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:19.444312 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e628573-9817-4161-9862-cf3f8b81faab tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:19.445292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e628573-9817-4161-9862-cf3f8b81faab tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:19.453394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e628573-9817-4161-9862-cf3f8b81faab tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:19.453944 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e628573-9817-4161-9862-cf3f8b81faab tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:19.454447 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e628573-9817-4161-9862-cf3f8b81faab tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:19.455160 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e628573-9817-4161-9862-cf3f8b81faab tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:19.455604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e628573-9817-4161-9862-cf3f8b81faab tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:19.456040 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e628573-9817-4161-9862-cf3f8b81faab tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:19.587986 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e628573-9817-4161-9862-cf3f8b81faab tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:19.597217 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e628573-9817-4161-9862-cf3f8b81faab tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.156879 Sep 08 13:54:19.597850 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 129/250] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:19 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:19.684762 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b77e89f-9b69-45c6-a114-cec8688bfe8b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:19.686849 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b77e89f-9b69-45c6-a114-cec8688bfe8b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:19.694734 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b77e89f-9b69-45c6-a114-cec8688bfe8b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:19.695335 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b77e89f-9b69-45c6-a114-cec8688bfe8b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:19.695967 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b77e89f-9b69-45c6-a114-cec8688bfe8b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:19.696678 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b77e89f-9b69-45c6-a114-cec8688bfe8b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:19.697134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b77e89f-9b69-45c6-a114-cec8688bfe8b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:19.697561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b77e89f-9b69-45c6-a114-cec8688bfe8b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:19.834819 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b77e89f-9b69-45c6-a114-cec8688bfe8b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:19.843532 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b77e89f-9b69-45c6-a114-cec8688bfe8b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.162790 Sep 08 13:54:19.844107 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 122/251] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:19 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:19.870406 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:19.871018 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:19.877643 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:19.878166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:19.878597 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:19.879291 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:19.879747 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:19.880170 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:19.946075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:19.954665 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:19.956112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:19.957200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-84511504-e748-4347-bdb0-e0f00328d913 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1276 microversion: 2.20 time: 0.090761 Sep 08 13:54:19.957764 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 130/252] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:19 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:20.149856 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ab1b606-e3ec-4525-bfd7-aef9678eeb17 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:20.150511 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3ab1b606-e3ec-4525-bfd7-aef9678eeb17 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:20.157117 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab1b606-e3ec-4525-bfd7-aef9678eeb17 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:20.157603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab1b606-e3ec-4525-bfd7-aef9678eeb17 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:20.158062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab1b606-e3ec-4525-bfd7-aef9678eeb17 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:20.158760 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab1b606-e3ec-4525-bfd7-aef9678eeb17 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:20.159212 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab1b606-e3ec-4525-bfd7-aef9678eeb17 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:20.159641 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ab1b606-e3ec-4525-bfd7-aef9678eeb17 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:20.221179 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ab1b606-e3ec-4525-bfd7-aef9678eeb17 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:20.228698 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ab1b606-e3ec-4525-bfd7-aef9678eeb17 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1270 microversion: 2.1 time: 0.082988 Sep 08 13:54:20.241907 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 123/253] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:20 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:20.619828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-71b88b28-23c4-4ec8-b741-e4c32d41792b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:20.620444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-71b88b28-23c4-4ec8-b741-e4c32d41792b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:20.628077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71b88b28-23c4-4ec8-b741-e4c32d41792b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:20.628488 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71b88b28-23c4-4ec8-b741-e4c32d41792b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:20.628920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71b88b28-23c4-4ec8-b741-e4c32d41792b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:20.629613 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71b88b28-23c4-4ec8-b741-e4c32d41792b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:20.630091 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71b88b28-23c4-4ec8-b741-e4c32d41792b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:20.630515 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-71b88b28-23c4-4ec8-b741-e4c32d41792b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:20.790155 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-71b88b28-23c4-4ec8-b741-e4c32d41792b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:20.799208 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-71b88b28-23c4-4ec8-b741-e4c32d41792b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.183664 Sep 08 13:54:20.811191 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 131/254] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:20 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:20.866210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1f4645a1-9506-4eef-a3da-5247a06105de tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:20.866821 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1f4645a1-9506-4eef-a3da-5247a06105de tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:20.872981 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4645a1-9506-4eef-a3da-5247a06105de tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:20.873527 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4645a1-9506-4eef-a3da-5247a06105de tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:20.874066 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4645a1-9506-4eef-a3da-5247a06105de tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:20.874821 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4645a1-9506-4eef-a3da-5247a06105de tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:20.875344 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4645a1-9506-4eef-a3da-5247a06105de tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:20.875833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1f4645a1-9506-4eef-a3da-5247a06105de tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:20.983778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:20.984784 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:20.991441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:20.992129 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:20.992742 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:20.993582 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:20.994192 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:20.994817 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:21.023573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1f4645a1-9506-4eef-a3da-5247a06105de tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:21.032097 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1f4645a1-9506-4eef-a3da-5247a06105de tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.169577 Sep 08 13:54:21.032658 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 124/255] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:20 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:21.060538 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:21.068519 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:21.069992 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:21.071098 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-421a8186-05e5-4f65-83cd-c4a964beb7e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1276 microversion: 2.20 time: 0.092539 Sep 08 13:54:21.071853 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 132/256] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:20 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:21.251225 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c0456a36-064b-40fb-bf1d-390754b05e0d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:21.251772 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c0456a36-064b-40fb-bf1d-390754b05e0d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:21.257562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0456a36-064b-40fb-bf1d-390754b05e0d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:21.258074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0456a36-064b-40fb-bf1d-390754b05e0d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:21.258507 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0456a36-064b-40fb-bf1d-390754b05e0d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:21.259268 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0456a36-064b-40fb-bf1d-390754b05e0d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:21.259725 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0456a36-064b-40fb-bf1d-390754b05e0d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:21.260153 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c0456a36-064b-40fb-bf1d-390754b05e0d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:21.323205 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c0456a36-064b-40fb-bf1d-390754b05e0d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:21.331791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c0456a36-064b-40fb-bf1d-390754b05e0d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1270 microversion: 2.1 time: 0.084992 Sep 08 13:54:21.332368 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 125/257] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:21 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:21.823356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-80b3c4c8-e348-4e6b-908b-6e2c8bafbaa8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:21.823960 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-80b3c4c8-e348-4e6b-908b-6e2c8bafbaa8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:21.830340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80b3c4c8-e348-4e6b-908b-6e2c8bafbaa8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:21.830811 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80b3c4c8-e348-4e6b-908b-6e2c8bafbaa8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:21.831233 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80b3c4c8-e348-4e6b-908b-6e2c8bafbaa8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:21.831911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80b3c4c8-e348-4e6b-908b-6e2c8bafbaa8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:21.832354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80b3c4c8-e348-4e6b-908b-6e2c8bafbaa8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:21.832767 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80b3c4c8-e348-4e6b-908b-6e2c8bafbaa8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:21.969063 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-80b3c4c8-e348-4e6b-908b-6e2c8bafbaa8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:21.977082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-80b3c4c8-e348-4e6b-908b-6e2c8bafbaa8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.157596 Sep 08 13:54:21.977721 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 133/258] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:21 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:22.055352 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cffc5fce-132c-4f32-8ef5-e18c9a0dc725 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:22.056074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cffc5fce-132c-4f32-8ef5-e18c9a0dc725 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:22.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cffc5fce-132c-4f32-8ef5-e18c9a0dc725 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:22.066661 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cffc5fce-132c-4f32-8ef5-e18c9a0dc725 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:22.067009 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cffc5fce-132c-4f32-8ef5-e18c9a0dc725 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:22.067721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cffc5fce-132c-4f32-8ef5-e18c9a0dc725 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:22.068289 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cffc5fce-132c-4f32-8ef5-e18c9a0dc725 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:22.068715 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cffc5fce-132c-4f32-8ef5-e18c9a0dc725 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:22.100326 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:22.100942 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:22.109046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:22.109719 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:22.110362 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:22.111240 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:22.111867 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:22.113020 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:22.240085 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:22.250743 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:22.252655 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:22.254156 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5d3b0174-e7cc-41d9-bae0-8a11c59263e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1276 microversion: 2.20 time: 0.161178 Sep 08 13:54:22.255497 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 134/259] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:22 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:22.297558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cffc5fce-132c-4f32-8ef5-e18c9a0dc725 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:22.306723 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cffc5fce-132c-4f32-8ef5-e18c9a0dc725 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.255057 Sep 08 13:54:22.307616 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 126/260] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:22 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:22.355374 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3a3b3f34-63ff-4b27-ab6c-5e9a0a92f6ab tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:22.356150 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3a3b3f34-63ff-4b27-ab6c-5e9a0a92f6ab tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:22.364187 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3b3f34-63ff-4b27-ab6c-5e9a0a92f6ab tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:22.364775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3b3f34-63ff-4b27-ab6c-5e9a0a92f6ab tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:22.365291 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3b3f34-63ff-4b27-ab6c-5e9a0a92f6ab tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:22.366116 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3b3f34-63ff-4b27-ab6c-5e9a0a92f6ab tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:22.366808 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3b3f34-63ff-4b27-ab6c-5e9a0a92f6ab tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:22.367327 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3b3f34-63ff-4b27-ab6c-5e9a0a92f6ab tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:22.390723 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:22.450317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a3b3f34-63ff-4b27-ab6c-5e9a0a92f6ab tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:22.458869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3a3b3f34-63ff-4b27-ab6c-5e9a0a92f6ab tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1270 microversion: 2.1 time: 0.107412 Sep 08 13:54:22.459443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 135/261] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:22 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:23.003501 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87ca6df1-13c8-4927-9103-51dfda0286e3 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:23.004494 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-87ca6df1-13c8-4927-9103-51dfda0286e3 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:23.011687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87ca6df1-13c8-4927-9103-51dfda0286e3 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:23.012176 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87ca6df1-13c8-4927-9103-51dfda0286e3 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:23.012671 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87ca6df1-13c8-4927-9103-51dfda0286e3 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:23.013705 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87ca6df1-13c8-4927-9103-51dfda0286e3 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:23.014456 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87ca6df1-13c8-4927-9103-51dfda0286e3 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:23.015077 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87ca6df1-13c8-4927-9103-51dfda0286e3 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:23.282011 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:23.282566 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:23.290433 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:23.290921 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:23.291353 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:23.292056 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:23.292538 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:23.292957 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:23.383591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:23.392762 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:23.394364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:23.395978 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e76faae4-d5f8-4357-8b3d-5271c80cf55a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1332 microversion: 2.20 time: 0.118331 Sep 08 13:54:23.407368 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-87ca6df1-13c8-4927-9103-51dfda0286e3 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:23.410408 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 136/262] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:23 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:54:23.410980 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:23.415588 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-14957afc-6e98-4f7f-a2b4-935260f67a6d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:23.416420 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87ca6df1-13c8-4927-9103-51dfda0286e3 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.419198 Sep 08 13:54:23.417170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 127/263] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:22 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:23.420601 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-14957afc-6e98-4f7f-a2b4-935260f67a6d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:23.427085 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14957afc-6e98-4f7f-a2b4-935260f67a6d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:23.427677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14957afc-6e98-4f7f-a2b4-935260f67a6d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:23.428718 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14957afc-6e98-4f7f-a2b4-935260f67a6d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:23.430215 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14957afc-6e98-4f7f-a2b4-935260f67a6d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:23.430320 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14957afc-6e98-4f7f-a2b4-935260f67a6d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:23.431227 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14957afc-6e98-4f7f-a2b4-935260f67a6d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:23.484583 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a47c9236-6905-4ed7-8da0-f9ddbdd4c965 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:23.485980 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a47c9236-6905-4ed7-8da0-f9ddbdd4c965 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:23.493871 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a47c9236-6905-4ed7-8da0-f9ddbdd4c965 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:23.494383 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a47c9236-6905-4ed7-8da0-f9ddbdd4c965 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:23.494816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a47c9236-6905-4ed7-8da0-f9ddbdd4c965 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:23.495505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a47c9236-6905-4ed7-8da0-f9ddbdd4c965 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:23.495945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a47c9236-6905-4ed7-8da0-f9ddbdd4c965 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:23.496360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a47c9236-6905-4ed7-8da0-f9ddbdd4c965 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:23.645581 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a47c9236-6905-4ed7-8da0-f9ddbdd4c965 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:23.653422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a47c9236-6905-4ed7-8da0-f9ddbdd4c965 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1276 microversion: 2.1 time: 0.175261 Sep 08 13:54:23.657973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 128/264] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:23 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:23.783097 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-14957afc-6e98-4f7f-a2b4-935260f67a6d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:23.792479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-14957afc-6e98-4f7f-a2b4-935260f67a6d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1521 microversion: 2.1 time: 0.380717 Sep 08 13:54:23.804273 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 137/265] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:23 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:23.906925 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-0674cf1b-9f4a-4b56-b050-18fd8907bc8a req-485cb354-8dd5-40da-83be-75cd49ae4991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e64a0c9-b7b0-46ff-8526-88164d493140", "name": "network-vif-plugged", "status": "completed", "tag": "ca4283b0-e159-4a24-b0b2-bc113ff78694"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:23.919138 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0674cf1b-9f4a-4b56-b050-18fd8907bc8a req-485cb354-8dd5-40da-83be-75cd49ae4991 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:23.920185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0674cf1b-9f4a-4b56-b050-18fd8907bc8a req-485cb354-8dd5-40da-83be-75cd49ae4991 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:23.920552 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-0674cf1b-9f4a-4b56-b050-18fd8907bc8a req-485cb354-8dd5-40da-83be-75cd49ae4991 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:23.932041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-0674cf1b-9f4a-4b56-b050-18fd8907bc8a req-485cb354-8dd5-40da-83be-75cd49ae4991 service nova] Creating event network-vif-plugged:ca4283b0-e159-4a24-b0b2-bc113ff78694 for instance 6e64a0c9-b7b0-46ff-8526-88164d493140 on hv-cinder-82002 Sep 08 13:54:23.937961 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-0674cf1b-9f4a-4b56-b050-18fd8907bc8a req-485cb354-8dd5-40da-83be-75cd49ae4991 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035035 Sep 08 13:54:23.938756 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 129/266] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:24.427865 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:24.428472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:24.435079 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:24.436112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:24.436553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:24.437255 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:24.437688 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:24.440093 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:24.446234 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7a681fcb-cd88-4976-b9c5-530a96b588d4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:24.446943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7a681fcb-cd88-4976-b9c5-530a96b588d4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:24.453792 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a681fcb-cd88-4976-b9c5-530a96b588d4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:24.454282 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a681fcb-cd88-4976-b9c5-530a96b588d4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:24.454896 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a681fcb-cd88-4976-b9c5-530a96b588d4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:24.455603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a681fcb-cd88-4976-b9c5-530a96b588d4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:24.456222 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a681fcb-cd88-4976-b9c5-530a96b588d4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:24.456646 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a681fcb-cd88-4976-b9c5-530a96b588d4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:24.569821 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:24.579293 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:24.580736 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:24.582157 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5de9f118-6acf-46a9-882d-ce73a06f664d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1332 microversion: 2.20 time: 0.158147 Sep 08 13:54:24.582713 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 138/267] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:24 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1332 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:24.679022 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2e86da82-18e9-412b-bd5d-0413be0a988e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:24.679799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2e86da82-18e9-412b-bd5d-0413be0a988e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:24.686874 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e86da82-18e9-412b-bd5d-0413be0a988e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:24.687575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e86da82-18e9-412b-bd5d-0413be0a988e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:24.688014 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e86da82-18e9-412b-bd5d-0413be0a988e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:24.688714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e86da82-18e9-412b-bd5d-0413be0a988e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:24.689166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e86da82-18e9-412b-bd5d-0413be0a988e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:24.689908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e86da82-18e9-412b-bd5d-0413be0a988e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:24.706576 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a681fcb-cd88-4976-b9c5-530a96b588d4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:24.714999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7a681fcb-cd88-4976-b9c5-530a96b588d4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.273779 Sep 08 13:54:24.715573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 130/268] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:24 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:24.817752 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b594ae6d-61b0-4e13-8884-d91f2da00ecb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:24.818762 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b594ae6d-61b0-4e13-8884-d91f2da00ecb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:24.825047 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b594ae6d-61b0-4e13-8884-d91f2da00ecb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:24.825558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b594ae6d-61b0-4e13-8884-d91f2da00ecb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:24.826597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b594ae6d-61b0-4e13-8884-d91f2da00ecb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:24.827299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b594ae6d-61b0-4e13-8884-d91f2da00ecb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:24.827744 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b594ae6d-61b0-4e13-8884-d91f2da00ecb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:24.828378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b594ae6d-61b0-4e13-8884-d91f2da00ecb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:24.932550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e86da82-18e9-412b-bd5d-0413be0a988e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:24.940153 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2e86da82-18e9-412b-bd5d-0413be0a988e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1318 microversion: 2.1 time: 0.265291 Sep 08 13:54:24.954053 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 139/269] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:24 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:25.079859 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b594ae6d-61b0-4e13-8884-d91f2da00ecb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:25.087632 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b594ae6d-61b0-4e13-8884-d91f2da00ecb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1501 microversion: 2.1 time: 0.273801 Sep 08 13:54:25.097759 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 131/270] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:24 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1501 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:25.111695 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31f02d89-9944-4069-a510-5c86c3f54727 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:25.112183 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-31f02d89-9944-4069-a510-5c86c3f54727 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:25.118597 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f02d89-9944-4069-a510-5c86c3f54727 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:25.119085 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f02d89-9944-4069-a510-5c86c3f54727 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:25.119527 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f02d89-9944-4069-a510-5c86c3f54727 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:25.120233 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f02d89-9944-4069-a510-5c86c3f54727 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:25.120690 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f02d89-9944-4069-a510-5c86c3f54727 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:25.121116 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31f02d89-9944-4069-a510-5c86c3f54727 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:25.323794 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-31f02d89-9944-4069-a510-5c86c3f54727 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:25.335130 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-31f02d89-9944-4069-a510-5c86c3f54727 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1515 microversion: 2.1 time: 0.227482 Sep 08 13:54:25.345800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 140/271] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:25 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:25.347533 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-87d27f32-4300-4ea3-8163-5f107dec6278 req-ac05d654-0201-457d-a711-bfbf140643ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef", "tag": "0677f870-39bb-4655-b43d-ef2acf0f9f1b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:25.361428 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-87d27f32-4300-4ea3-8163-5f107dec6278 req-ac05d654-0201-457d-a711-bfbf140643ed service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:25.362243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-87d27f32-4300-4ea3-8163-5f107dec6278 req-ac05d654-0201-457d-a711-bfbf140643ed service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:25.362675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-87d27f32-4300-4ea3-8163-5f107dec6278 req-ac05d654-0201-457d-a711-bfbf140643ed service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:25.376238 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-87d27f32-4300-4ea3-8163-5f107dec6278 req-ac05d654-0201-457d-a711-bfbf140643ed service nova] Creating event network-changed:0677f870-39bb-4655-b43d-ef2acf0f9f1b for instance e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef on hv-cinder-82002 Sep 08 13:54:25.381651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-87d27f32-4300-4ea3-8163-5f107dec6278 req-ac05d654-0201-457d-a711-bfbf140643ed service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038070 Sep 08 13:54:25.383168 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 132/272] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:25.617417 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:25.619180 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:25.649988 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:25.650715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:25.651457 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:25.653362 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:25.655173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:25.656135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:25.738146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ada1162-7149-48e8-b38a-7cc83ef89896 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:25.738850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2ada1162-7149-48e8-b38a-7cc83ef89896 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:25.745324 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ada1162-7149-48e8-b38a-7cc83ef89896 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:25.745840 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ada1162-7149-48e8-b38a-7cc83ef89896 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:25.753896 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ada1162-7149-48e8-b38a-7cc83ef89896 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:25.754113 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:25.755199 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ada1162-7149-48e8-b38a-7cc83ef89896 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:25.755941 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ada1162-7149-48e8-b38a-7cc83ef89896 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:25.756539 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ada1162-7149-48e8-b38a-7cc83ef89896 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:25.765145 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:25.766621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:25.768160 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e78c34dc-a2b6-4e5a-83ef-cd6d481b1d4e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1332 microversion: 2.20 time: 0.156034 Sep 08 13:54:25.783177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 141/273] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:25 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1332 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:25.963826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d76bb8fd-5865-42af-b561-0b5bc5f41e87 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:25.965399 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d76bb8fd-5865-42af-b561-0b5bc5f41e87 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:25.972154 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76bb8fd-5865-42af-b561-0b5bc5f41e87 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:25.972646 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76bb8fd-5865-42af-b561-0b5bc5f41e87 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:25.973132 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76bb8fd-5865-42af-b561-0b5bc5f41e87 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:25.973963 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76bb8fd-5865-42af-b561-0b5bc5f41e87 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:25.974745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76bb8fd-5865-42af-b561-0b5bc5f41e87 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:25.975614 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d76bb8fd-5865-42af-b561-0b5bc5f41e87 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:26.089374 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ada1162-7149-48e8-b38a-7cc83ef89896 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:26.097390 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ada1162-7149-48e8-b38a-7cc83ef89896 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.363714 Sep 08 13:54:26.098116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 133/274] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:25 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:26.179516 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d76bb8fd-5865-42af-b561-0b5bc5f41e87 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:26.187730 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d76bb8fd-5865-42af-b561-0b5bc5f41e87 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1318 microversion: 2.1 time: 0.228272 Sep 08 13:54:26.188485 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 142/275] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:25 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:26.796088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:26.797462 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:26.803456 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:26.804006 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:26.804501 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:26.805434 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:26.806079 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:26.806503 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:26.816630 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8271a0ad-2f59-406e-ad26-1818ea7ae325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:26.818997 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8271a0ad-2f59-406e-ad26-1818ea7ae325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:26.825305 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8271a0ad-2f59-406e-ad26-1818ea7ae325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:26.825870 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8271a0ad-2f59-406e-ad26-1818ea7ae325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:26.826847 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8271a0ad-2f59-406e-ad26-1818ea7ae325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:26.827547 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8271a0ad-2f59-406e-ad26-1818ea7ae325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:26.828219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8271a0ad-2f59-406e-ad26-1818ea7ae325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:26.828837 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8271a0ad-2f59-406e-ad26-1818ea7ae325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:26.853953 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-8271a0ad-2f59-406e-ad26-1818ea7ae325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lazy-loading 'flavor' on Instance uuid f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:54:26.886678 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:26.905010 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:26.906629 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:26.907881 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2153c276-4404-4ec7-9a2e-b526a29aa137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1340 microversion: 2.20 time: 0.115606 Sep 08 13:54:26.908514 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 134/276] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:26 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1340 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:26.983689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8271a0ad-2f59-406e-ad26-1818ea7ae325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "POST /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c/action" status: 200 len: 32 microversion: 2.1 time: 0.170932 Sep 08 13:54:26.984330 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 143/277] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:54:26 2022] POST /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 13:54:26.993768 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b0bd2884-f2a1-45a9-8276-6f2d214bf62c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:26.994386 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b0bd2884-f2a1-45a9-8276-6f2d214bf62c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:27.002492 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0bd2884-f2a1-45a9-8276-6f2d214bf62c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:27.003322 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0bd2884-f2a1-45a9-8276-6f2d214bf62c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:27.003763 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0bd2884-f2a1-45a9-8276-6f2d214bf62c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:27.004460 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0bd2884-f2a1-45a9-8276-6f2d214bf62c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:27.005020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0bd2884-f2a1-45a9-8276-6f2d214bf62c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:27.005464 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b0bd2884-f2a1-45a9-8276-6f2d214bf62c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:27.123772 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-673574a7-cade-466e-ab6e-3eae55384336 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:27.124524 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-673574a7-cade-466e-ab6e-3eae55384336 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:27.131449 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673574a7-cade-466e-ab6e-3eae55384336 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:27.131627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673574a7-cade-466e-ab6e-3eae55384336 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:27.131902 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673574a7-cade-466e-ab6e-3eae55384336 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:27.132802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673574a7-cade-466e-ab6e-3eae55384336 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:27.133250 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673574a7-cade-466e-ab6e-3eae55384336 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:27.134167 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-673574a7-cade-466e-ab6e-3eae55384336 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:27.154084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b0bd2884-f2a1-45a9-8276-6f2d214bf62c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:27.166599 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b0bd2884-f2a1-45a9-8276-6f2d214bf62c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.175605 Sep 08 13:54:27.167865 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 135/278] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:26 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:27.214262 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-abd0f37a-d4f6-4e66-af35-343b6ff0a873 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:27.214905 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-abd0f37a-d4f6-4e66-af35-343b6ff0a873 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:27.221726 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd0f37a-d4f6-4e66-af35-343b6ff0a873 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:27.222256 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd0f37a-d4f6-4e66-af35-343b6ff0a873 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:27.222700 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd0f37a-d4f6-4e66-af35-343b6ff0a873 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:27.223412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd0f37a-d4f6-4e66-af35-343b6ff0a873 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:27.223873 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd0f37a-d4f6-4e66-af35-343b6ff0a873 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:27.224282 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd0f37a-d4f6-4e66-af35-343b6ff0a873 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:27.720250 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-673574a7-cade-466e-ab6e-3eae55384336 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:27.724425 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-abd0f37a-d4f6-4e66-af35-343b6ff0a873 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:27.729485 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-673574a7-cade-466e-ab6e-3eae55384336 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1357 microversion: 2.1 time: 0.612166 Sep 08 13:54:27.730855 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 144/279] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:27 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1357 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:27.732836 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-abd0f37a-d4f6-4e66-af35-343b6ff0a873 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1318 microversion: 2.1 time: 0.524299 Sep 08 13:54:27.733411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 136/280] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:27 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:27.936485 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:27.937532 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:27.943491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:27.944038 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:27.944476 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:27.945360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:27.945840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:27.946267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:28.019133 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:28.028930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:28.028930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:28.029978 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eda2eb4f-cb91-41e3-aa77-d1ebfb84da66 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1338 microversion: 2.20 time: 0.097469 Sep 08 13:54:28.031246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 145/281] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:27 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:28.191025 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9e25eddd-34b1-4ec4-b19b-f3676c62c773 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:28.191638 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9e25eddd-34b1-4ec4-b19b-f3676c62c773 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:28.197629 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e25eddd-34b1-4ec4-b19b-f3676c62c773 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:28.198139 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e25eddd-34b1-4ec4-b19b-f3676c62c773 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:28.198573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e25eddd-34b1-4ec4-b19b-f3676c62c773 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:28.199261 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e25eddd-34b1-4ec4-b19b-f3676c62c773 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:28.199712 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e25eddd-34b1-4ec4-b19b-f3676c62c773 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:28.200129 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9e25eddd-34b1-4ec4-b19b-f3676c62c773 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:28.340744 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9e25eddd-34b1-4ec4-b19b-f3676c62c773 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:28.350563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9e25eddd-34b1-4ec4-b19b-f3676c62c773 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.163326 Sep 08 13:54:28.351159 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 137/282] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:28 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:28.756349 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2c716c3f-dd50-49cf-8519-741c2ae321a9 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:28.757498 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2c716c3f-dd50-49cf-8519-741c2ae321a9 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:28.759341 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:28.760076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=14 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:28.766239 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c716c3f-dd50-49cf-8519-741c2ae321a9 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:28.766989 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c716c3f-dd50-49cf-8519-741c2ae321a9 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:28.767620 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c716c3f-dd50-49cf-8519-741c2ae321a9 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:28.768767 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c716c3f-dd50-49cf-8519-741c2ae321a9 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:28.768892 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3e05e2d-230c-4b55-aa3b-5d7a01ede76f tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:28.769554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d3e05e2d-230c-4b55-aa3b-5d7a01ede76f tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:28.769845 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c716c3f-dd50-49cf-8519-741c2ae321a9 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:28.770421 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2c716c3f-dd50-49cf-8519-741c2ae321a9 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:28.778222 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3e05e2d-230c-4b55-aa3b-5d7a01ede76f tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:28.779484 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3e05e2d-230c-4b55-aa3b-5d7a01ede76f tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:28.780213 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3e05e2d-230c-4b55-aa3b-5d7a01ede76f tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:28.781086 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3e05e2d-230c-4b55-aa3b-5d7a01ede76f tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:28.782182 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3e05e2d-230c-4b55-aa3b-5d7a01ede76f tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:28.782770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d3e05e2d-230c-4b55-aa3b-5d7a01ede76f tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:28.830413 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:29.093118 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d3e05e2d-230c-4b55-aa3b-5d7a01ede76f tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:29.102724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d3e05e2d-230c-4b55-aa3b-5d7a01ede76f tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1548 microversion: 2.1 time: 0.352768 Sep 08 13:54:29.102895 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2c716c3f-dd50-49cf-8519-741c2ae321a9 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:29.114251 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2c716c3f-dd50-49cf-8519-741c2ae321a9 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1318 microversion: 2.1 time: 0.361775 Sep 08 13:54:29.115058 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 138/283] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:28 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:29.118919 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 146/284] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:28 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1548 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:29.132263 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-065ea194-9577-486f-a763-306322bac913 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:29.133190 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-065ea194-9577-486f-a763-306322bac913 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:29.138538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:29.139553 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:29.145647 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-065ea194-9577-486f-a763-306322bac913 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.146308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-065ea194-9577-486f-a763-306322bac913 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.146683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.146817 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-065ea194-9577-486f-a763-306322bac913 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.147178 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.147707 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-065ea194-9577-486f-a763-306322bac913 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.148013 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.148554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-065ea194-9577-486f-a763-306322bac913 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.149273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.149392 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-065ea194-9577-486f-a763-306322bac913 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.149890 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.150756 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.281362 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:29.302703 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:29.304576 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:29.305750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-47704f64-a135-424b-92f2-a91cf32220f1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1338 microversion: 2.20 time: 0.189533 Sep 08 13:54:29.306505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 139/285] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:29 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1338 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:29.375129 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-21533592-70fe-49e2-864e-d94bf3c86526 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:29.375741 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-21533592-70fe-49e2-864e-d94bf3c86526 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:29.377631 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:29.383456 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21533592-70fe-49e2-864e-d94bf3c86526 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.383938 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21533592-70fe-49e2-864e-d94bf3c86526 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.384370 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21533592-70fe-49e2-864e-d94bf3c86526 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.385076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21533592-70fe-49e2-864e-d94bf3c86526 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.385527 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21533592-70fe-49e2-864e-d94bf3c86526 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.385984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-21533592-70fe-49e2-864e-d94bf3c86526 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.410920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-065ea194-9577-486f-a763-306322bac913 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:29.419099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-065ea194-9577-486f-a763-306322bac913 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1548 microversion: 2.1 time: 0.292016 Sep 08 13:54:29.420284 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 147/286] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:29 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1548 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:29.443266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3a2beaa4-32d5-4e51-b582-7fec846a317a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:29.448689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a2beaa4-32d5-4e51-b582-7fec846a317a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:29.449557 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3a2beaa4-32d5-4e51-b582-7fec846a317a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Searching by: {'deleted': False, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4'} {{(pid=126919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 13:54:29.456213 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a2beaa4-32d5-4e51-b582-7fec846a317a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.456693 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a2beaa4-32d5-4e51-b582-7fec846a317a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.457120 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a2beaa4-32d5-4e51-b582-7fec846a317a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.457867 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a2beaa4-32d5-4e51-b582-7fec846a317a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.458314 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a2beaa4-32d5-4e51-b582-7fec846a317a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.458733 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a2beaa4-32d5-4e51-b582-7fec846a317a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.551979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.multi_cell_list [None req-3a2beaa4-32d5-4e51-b582-7fec846a317a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 13:54:29.614675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-21533592-70fe-49e2-864e-d94bf3c86526 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:29.623183 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-21533592-70fe-49e2-864e-d94bf3c86526 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.253141 Sep 08 13:54:29.623956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 140/287] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:29 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:29.648758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3a2beaa4-32d5-4e51-b582-7fec846a317a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209432 Sep 08 13:54:29.649350 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 148/288] 10.222.0.55 () {58 vars in 1125 bytes} [Thu Sep 8 13:54:29 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:54:29.661854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-13564c20-1bc3-4896-a404-a11008ee5a93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:29.662467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-13564c20-1bc3-4896-a404-a11008ee5a93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:29.668343 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13564c20-1bc3-4896-a404-a11008ee5a93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.668823 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13564c20-1bc3-4896-a404-a11008ee5a93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.669320 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13564c20-1bc3-4896-a404-a11008ee5a93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.670020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13564c20-1bc3-4896-a404-a11008ee5a93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.670471 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13564c20-1bc3-4896-a404-a11008ee5a93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.670887 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13564c20-1bc3-4896-a404-a11008ee5a93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.884878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-13564c20-1bc3-4896-a404-a11008ee5a93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:29.893244 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-13564c20-1bc3-4896-a404-a11008ee5a93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1548 microversion: 2.1 time: 0.235654 Sep 08 13:54:29.893829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 141/289] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:29 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1548 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:30.152654 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-005691cc-83aa-4af2-98b9-52f7b754f77f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:30.152654 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-005691cc-83aa-4af2-98b9-52f7b754f77f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:30.152654 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-005691cc-83aa-4af2-98b9-52f7b754f77f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:30.153266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-005691cc-83aa-4af2-98b9-52f7b754f77f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:30.153572 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-005691cc-83aa-4af2-98b9-52f7b754f77f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:30.154596 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-005691cc-83aa-4af2-98b9-52f7b754f77f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:30.155013 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-005691cc-83aa-4af2-98b9-52f7b754f77f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:30.155504 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-005691cc-83aa-4af2-98b9-52f7b754f77f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:30.292287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-005691cc-83aa-4af2-98b9-52f7b754f77f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:30.296421 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:30.301503 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-005691cc-83aa-4af2-98b9-52f7b754f77f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1318 microversion: 2.1 time: 0.160401 Sep 08 13:54:30.302091 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 149/290] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:30 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:30.330414 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:30.331096 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:30.336797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:30.337571 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:30.338022 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:30.338706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:30.339150 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:30.339561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:30.587714 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:30.596100 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:30.597545 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:30.598689 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-16df1599-65a0-4df8-b999-4a32ae8887c4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1406 microversion: 2.20 time: 0.272142 Sep 08 13:54:30.599518 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 142/291] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:30 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:30.646725 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0d7f4529-515e-4004-8385-7807d17a5c0a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:30.647326 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0d7f4529-515e-4004-8385-7807d17a5c0a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:30.654700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d7f4529-515e-4004-8385-7807d17a5c0a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:30.655186 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d7f4529-515e-4004-8385-7807d17a5c0a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:30.655612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d7f4529-515e-4004-8385-7807d17a5c0a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:30.656590 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d7f4529-515e-4004-8385-7807d17a5c0a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:30.657052 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d7f4529-515e-4004-8385-7807d17a5c0a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:30.657472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0d7f4529-515e-4004-8385-7807d17a5c0a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:30.867256 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0d7f4529-515e-4004-8385-7807d17a5c0a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:30.875293 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0d7f4529-515e-4004-8385-7807d17a5c0a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.232380 Sep 08 13:54:30.875946 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 150/292] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:30 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:31.326356 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d8973515-7db7-4808-9cf9-7945abe7ce98 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:31.327716 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d8973515-7db7-4808-9cf9-7945abe7ce98 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:31.335976 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8973515-7db7-4808-9cf9-7945abe7ce98 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.336554 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8973515-7db7-4808-9cf9-7945abe7ce98 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.336882 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8973515-7db7-4808-9cf9-7945abe7ce98 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.338057 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8973515-7db7-4808-9cf9-7945abe7ce98 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.338906 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8973515-7db7-4808-9cf9-7945abe7ce98 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.339340 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8973515-7db7-4808-9cf9-7945abe7ce98 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.434804 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-90e08254-b3f7-4221-8a34-78bcf6c964d0 req-7f2a1fd7-fc7a-4850-8105-cf55c98fcbaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efdb4c65-ed8d-4792-ac96-8b1053b167b5", "tag": "c9da782b-975b-4d78-bc93-092cf58fcf3a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:31.454804 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-90e08254-b3f7-4221-8a34-78bcf6c964d0 req-7f2a1fd7-fc7a-4850-8105-cf55c98fcbaa service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.455282 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-90e08254-b3f7-4221-8a34-78bcf6c964d0 req-7f2a1fd7-fc7a-4850-8105-cf55c98fcbaa service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.455755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-90e08254-b3f7-4221-8a34-78bcf6c964d0 req-7f2a1fd7-fc7a-4850-8105-cf55c98fcbaa service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.468767 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-90e08254-b3f7-4221-8a34-78bcf6c964d0 req-7f2a1fd7-fc7a-4850-8105-cf55c98fcbaa service nova] Creating event network-changed:c9da782b-975b-4d78-bc93-092cf58fcf3a for instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 on hv-cinder-82002 Sep 08 13:54:31.483318 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-90e08254-b3f7-4221-8a34-78bcf6c964d0 req-7f2a1fd7-fc7a-4850-8105-cf55c98fcbaa service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052693 Sep 08 13:54:31.484155 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 151/293] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:54:31.521652 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b6126166-47c1-4c7c-838b-047a5e609399 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12801054-b941-429c-979e-989ba1d4ae5b"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:31.524930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b6126166-47c1-4c7c-838b-047a5e609399 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:31.531248 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6126166-47c1-4c7c-838b-047a5e609399 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.531835 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6126166-47c1-4c7c-838b-047a5e609399 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.532331 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6126166-47c1-4c7c-838b-047a5e609399 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.533094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6126166-47c1-4c7c-838b-047a5e609399 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.533616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6126166-47c1-4c7c-838b-047a5e609399 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.534137 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b6126166-47c1-4c7c-838b-047a5e609399 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.600334 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8973515-7db7-4808-9cf9-7945abe7ce98 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:31.608437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d8973515-7db7-4808-9cf9-7945abe7ce98 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1318 microversion: 2.1 time: 0.287286 Sep 08 13:54:31.609477 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 143/294] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:31 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:31.625187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:31.625960 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:31.631875 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.632447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.633035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.633726 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.634211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.634610 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.826529 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:31.835685 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:31.837343 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:31.838805 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4b15d12e-c29a-4ed8-918b-2ff135b109e3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1406 microversion: 2.20 time: 0.217973 Sep 08 13:54:31.839360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 144/295] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:31 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:54:31.899724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d60f461c-6261-4ac9-95f5-47ececda65d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:31.900453 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d60f461c-6261-4ac9-95f5-47ececda65d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:31.906834 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60f461c-6261-4ac9-95f5-47ececda65d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.907446 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60f461c-6261-4ac9-95f5-47ececda65d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.908137 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60f461c-6261-4ac9-95f5-47ececda65d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.909000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60f461c-6261-4ac9-95f5-47ececda65d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.909564 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60f461c-6261-4ac9-95f5-47ececda65d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.910502 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60f461c-6261-4ac9-95f5-47ececda65d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:32.088479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b6126166-47c1-4c7c-838b-047a5e609399 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "POST /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572151 Sep 08 13:54:32.093847 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 152/296] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 13:54:31 2022] POST /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:32.094020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d60f461c-6261-4ac9-95f5-47ececda65d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:32.095050 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:32.100434 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d60f461c-6261-4ac9-95f5-47ececda65d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.204964 Sep 08 13:54:32.101001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 145/297] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:31 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:32.632870 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2e3447d6-58fe-4665-b122-2f48f9ae5e82 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:32.633758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2e3447d6-58fe-4665-b122-2f48f9ae5e82 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:32.641784 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e3447d6-58fe-4665-b122-2f48f9ae5e82 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:32.642470 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e3447d6-58fe-4665-b122-2f48f9ae5e82 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:32.642896 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e3447d6-58fe-4665-b122-2f48f9ae5e82 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:32.643728 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e3447d6-58fe-4665-b122-2f48f9ae5e82 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:32.644204 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e3447d6-58fe-4665-b122-2f48f9ae5e82 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:32.644612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e3447d6-58fe-4665-b122-2f48f9ae5e82 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:32.865134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:32.865767 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:32.872474 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:32.873065 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:32.873498 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:32.874317 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:32.874767 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:32.875188 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:33.208348 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e3447d6-58fe-4665-b122-2f48f9ae5e82 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:33.217364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2e3447d6-58fe-4665-b122-2f48f9ae5e82 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1318 microversion: 2.1 time: 0.588974 Sep 08 13:54:33.218269 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 153/298] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:32 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:33.222845 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a32f755d-c918-46db-a9a7-921a7c1a0b38 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:33.223568 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a32f755d-c918-46db-a9a7-921a7c1a0b38 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:33.228693 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:33.229989 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32f755d-c918-46db-a9a7-921a7c1a0b38 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:33.230579 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32f755d-c918-46db-a9a7-921a7c1a0b38 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:33.231118 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32f755d-c918-46db-a9a7-921a7c1a0b38 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:33.231986 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32f755d-c918-46db-a9a7-921a7c1a0b38 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:33.232520 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32f755d-c918-46db-a9a7-921a7c1a0b38 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:33.233006 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a32f755d-c918-46db-a9a7-921a7c1a0b38 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:33.242018 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:33.244439 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:33.245700 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-80d8a22c-4451-4369-ae17-5d3256279929 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1406 microversion: 2.20 time: 0.384700 Sep 08 13:54:33.246536 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 146/299] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:32 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:54:33.372462 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a32f755d-c918-46db-a9a7-921a7c1a0b38 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:33.380635 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a32f755d-c918-46db-a9a7-921a7c1a0b38 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.161304 Sep 08 13:54:33.381194 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 154/300] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:33 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:34.094187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-5894d5ee-0fcc-4774-8cff-25a1b2e5ddb2 req-0e1b7cfe-da6e-4c87-9b17-36388da4b1dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef", "name": "network-vif-plugged", "status": "completed", "tag": "0677f870-39bb-4655-b43d-ef2acf0f9f1b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:34.104397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5894d5ee-0fcc-4774-8cff-25a1b2e5ddb2 req-0e1b7cfe-da6e-4c87-9b17-36388da4b1dd service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.105000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5894d5ee-0fcc-4774-8cff-25a1b2e5ddb2 req-0e1b7cfe-da6e-4c87-9b17-36388da4b1dd service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.105599 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5894d5ee-0fcc-4774-8cff-25a1b2e5ddb2 req-0e1b7cfe-da6e-4c87-9b17-36388da4b1dd service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.128087 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-5894d5ee-0fcc-4774-8cff-25a1b2e5ddb2 req-0e1b7cfe-da6e-4c87-9b17-36388da4b1dd service nova] Creating event network-vif-plugged:0677f870-39bb-4655-b43d-ef2acf0f9f1b for instance e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef on hv-cinder-82002 Sep 08 13:54:34.133991 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-5894d5ee-0fcc-4774-8cff-25a1b2e5ddb2 req-0e1b7cfe-da6e-4c87-9b17-36388da4b1dd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044075 Sep 08 13:54:34.134638 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 147/301] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:34.229542 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-26a00a0f-c1d7-461f-bc1e-370af031e69f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:34.230178 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-26a00a0f-c1d7-461f-bc1e-370af031e69f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:34.232615 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:34.237648 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26a00a0f-c1d7-461f-bc1e-370af031e69f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.238161 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26a00a0f-c1d7-461f-bc1e-370af031e69f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.238703 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26a00a0f-c1d7-461f-bc1e-370af031e69f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.239285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26a00a0f-c1d7-461f-bc1e-370af031e69f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.239736 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26a00a0f-c1d7-461f-bc1e-370af031e69f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.240189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26a00a0f-c1d7-461f-bc1e-370af031e69f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.244669 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-80dea78f-2f50-4d6d-b89f-806598308356 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:34.245770 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-80dea78f-2f50-4d6d-b89f-806598308356 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:34.252956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80dea78f-2f50-4d6d-b89f-806598308356 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.253475 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80dea78f-2f50-4d6d-b89f-806598308356 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.254088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80dea78f-2f50-4d6d-b89f-806598308356 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.254975 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80dea78f-2f50-4d6d-b89f-806598308356 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.255748 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80dea78f-2f50-4d6d-b89f-806598308356 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.256360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-80dea78f-2f50-4d6d-b89f-806598308356 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.271632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-26a00a0f-c1d7-461f-bc1e-370af031e69f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/ips" status: 200 len: 145 microversion: 2.1 time: 0.044259 Sep 08 13:54:34.272787 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 155/302] 10.222.0.55 () {58 vars in 1248 bytes} [Thu Sep 8 13:54:34 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:34.282415 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:34.282951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:34.288965 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.289461 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.290524 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.291228 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.291835 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.292579 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.437410 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-80dea78f-2f50-4d6d-b89f-806598308356 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:34.445215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-80dea78f-2f50-4d6d-b89f-806598308356 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1318 microversion: 2.1 time: 0.206420 Sep 08 13:54:34.445809 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 148/303] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:34 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:34.450350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b493d107-f115-49ac-80f5-005a3ed7fa1a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:34.451489 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b493d107-f115-49ac-80f5-005a3ed7fa1a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:34.457308 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b493d107-f115-49ac-80f5-005a3ed7fa1a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.457819 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b493d107-f115-49ac-80f5-005a3ed7fa1a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.458257 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b493d107-f115-49ac-80f5-005a3ed7fa1a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.459143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b493d107-f115-49ac-80f5-005a3ed7fa1a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.459765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b493d107-f115-49ac-80f5-005a3ed7fa1a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.460192 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b493d107-f115-49ac-80f5-005a3ed7fa1a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.468996 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:34.476964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:34.478440 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:34.479541 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-580bdd4d-c899-4f52-89eb-c6be72e72303 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1406 microversion: 2.20 time: 0.201405 Sep 08 13:54:34.480094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 156/304] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:34 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:34.590898 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b493d107-f115-49ac-80f5-005a3ed7fa1a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:34.599057 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b493d107-f115-49ac-80f5-005a3ed7fa1a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.152230 Sep 08 13:54:34.599559 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 149/305] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:34 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:34.715466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-702713d0-444b-4fd7-9ae7-93533a1c4517 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:34.716010 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-702713d0-444b-4fd7-9ae7-93533a1c4517 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:34.725938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702713d0-444b-4fd7-9ae7-93533a1c4517 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.725938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702713d0-444b-4fd7-9ae7-93533a1c4517 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.725938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702713d0-444b-4fd7-9ae7-93533a1c4517 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.725938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702713d0-444b-4fd7-9ae7-93533a1c4517 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.726436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702713d0-444b-4fd7-9ae7-93533a1c4517 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.726436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-702713d0-444b-4fd7-9ae7-93533a1c4517 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.748817 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-702713d0-444b-4fd7-9ae7-93533a1c4517 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/ips" status: 200 len: 150 microversion: 2.1 time: 0.037446 Sep 08 13:54:34.749392 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 157/306] 10.222.0.55 () {58 vars in 1248 bytes} [Thu Sep 8 13:54:34 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:35.468898 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b453bfd4-d11c-4c50-85ee-15c8ae365a56 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:35.470171 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b453bfd4-d11c-4c50-85ee-15c8ae365a56 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:35.481055 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b453bfd4-d11c-4c50-85ee-15c8ae365a56 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:35.481839 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b453bfd4-d11c-4c50-85ee-15c8ae365a56 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:35.482427 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b453bfd4-d11c-4c50-85ee-15c8ae365a56 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:35.483292 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b453bfd4-d11c-4c50-85ee-15c8ae365a56 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:35.483901 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b453bfd4-d11c-4c50-85ee-15c8ae365a56 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:35.484492 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b453bfd4-d11c-4c50-85ee-15c8ae365a56 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:35.507508 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:35.509583 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:35.522677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:35.523608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:35.524288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:35.525358 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:35.526377 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:35.526976 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:35.795300 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b453bfd4-d11c-4c50-85ee-15c8ae365a56 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:35.804094 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b453bfd4-d11c-4c50-85ee-15c8ae365a56 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1318 microversion: 2.1 time: 0.339093 Sep 08 13:54:35.805176 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 150/307] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:35 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:35.810236 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca1a7857-2bc8-47e0-ba8f-57d4950a390d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:35.811025 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca1a7857-2bc8-47e0-ba8f-57d4950a390d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:35.818015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:35.821655 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca1a7857-2bc8-47e0-ba8f-57d4950a390d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:35.822299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca1a7857-2bc8-47e0-ba8f-57d4950a390d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:35.822832 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca1a7857-2bc8-47e0-ba8f-57d4950a390d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:35.823640 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca1a7857-2bc8-47e0-ba8f-57d4950a390d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:35.824220 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca1a7857-2bc8-47e0-ba8f-57d4950a390d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:35.824747 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca1a7857-2bc8-47e0-ba8f-57d4950a390d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:35.828554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:35.830641 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:35.832346 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6a1e528b-ef09-4996-8694-950c1dcf07e2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1406 microversion: 2.20 time: 0.331627 Sep 08 13:54:35.833057 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 158/308] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:35 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:54:35.975132 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca1a7857-2bc8-47e0-ba8f-57d4950a390d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:35.983132 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca1a7857-2bc8-47e0-ba8f-57d4950a390d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.176629 Sep 08 13:54:35.983831 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 151/309] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:35 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:36.150663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d182fe1d-d52d-46cb-9c0c-443b8e62608a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab642d3d-1712-4435-a8e6-3ab0eb1375c2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:36.153429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d182fe1d-d52d-46cb-9c0c-443b8e62608a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:36.160730 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d182fe1d-d52d-46cb-9c0c-443b8e62608a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:36.161473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d182fe1d-d52d-46cb-9c0c-443b8e62608a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:36.162144 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d182fe1d-d52d-46cb-9c0c-443b8e62608a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:36.163105 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d182fe1d-d52d-46cb-9c0c-443b8e62608a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:36.164028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d182fe1d-d52d-46cb-9c0c-443b8e62608a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:36.164664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d182fe1d-d52d-46cb-9c0c-443b8e62608a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:36.828010 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d60dd5bc-e367-4670-aef9-ad0f07297106 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:36.828010 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d60dd5bc-e367-4670-aef9-ad0f07297106 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:36.835400 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60dd5bc-e367-4670-aef9-ad0f07297106 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:36.836094 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60dd5bc-e367-4670-aef9-ad0f07297106 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:36.836741 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60dd5bc-e367-4670-aef9-ad0f07297106 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:36.838257 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60dd5bc-e367-4670-aef9-ad0f07297106 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:36.838917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60dd5bc-e367-4670-aef9-ad0f07297106 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:36.839687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d60dd5bc-e367-4670-aef9-ad0f07297106 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:37.064095 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d60dd5bc-e367-4670-aef9-ad0f07297106 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:37.071834 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d60dd5bc-e367-4670-aef9-ad0f07297106 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1318 microversion: 2.1 time: 0.249002 Sep 08 13:54:37.072840 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 152/310] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:36 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:37.077323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:37.078062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:37.084752 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:37.085238 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:37.085662 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:37.086532 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:37.087578 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:37.088161 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:37.134930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d182fe1d-d52d-46cb-9c0c-443b8e62608a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.987890 Sep 08 13:54:37.136010 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 159/311] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 13:54:36 2022] POST /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-volume_attachments => generated 194 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:37.141946 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d7d0f741-2fdf-41d0-8a1d-a9e2f698f319 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:37.154608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d7d0f741-2fdf-41d0-8a1d-a9e2f698f319 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:37.172915 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d0f741-2fdf-41d0-8a1d-a9e2f698f319 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:37.176558 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d0f741-2fdf-41d0-8a1d-a9e2f698f319 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:37.177457 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d0f741-2fdf-41d0-8a1d-a9e2f698f319 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:37.181419 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d0f741-2fdf-41d0-8a1d-a9e2f698f319 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:37.182054 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d0f741-2fdf-41d0-8a1d-a9e2f698f319 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:37.182582 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7d0f741-2fdf-41d0-8a1d-a9e2f698f319 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:37.454246 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:37.457605 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d7d0f741-2fdf-41d0-8a1d-a9e2f698f319 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:37.462780 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:37.464404 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:37.465703 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b522bc89-4ceb-47e0-b135-4b041402d436 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1406 microversion: 2.20 time: 0.391943 Sep 08 13:54:37.466367 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 153/312] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:37 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:37.467317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d7d0f741-2fdf-41d0-8a1d-a9e2f698f319 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.329782 Sep 08 13:54:37.467880 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 160/313] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:37 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:38.096219 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd9b08c7-f897-431c-b5e9-587edd7b39ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:38.096839 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd9b08c7-f897-431c-b5e9-587edd7b39ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:38.102796 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd9b08c7-f897-431c-b5e9-587edd7b39ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:38.103282 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd9b08c7-f897-431c-b5e9-587edd7b39ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:38.103715 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd9b08c7-f897-431c-b5e9-587edd7b39ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:38.104404 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd9b08c7-f897-431c-b5e9-587edd7b39ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:38.104859 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd9b08c7-f897-431c-b5e9-587edd7b39ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:38.105285 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd9b08c7-f897-431c-b5e9-587edd7b39ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:38.244361 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd9b08c7-f897-431c-b5e9-587edd7b39ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:38.252522 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd9b08c7-f897-431c-b5e9-587edd7b39ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1318 microversion: 2.1 time: 0.160170 Sep 08 13:54:38.253091 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 154/314] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:38 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:38.495212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b95361fd-a4a2-44b6-8e44-3d8254470d09 req-6a862473-4bae-4e11-a96a-be85bc3df6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdb4c65-ed8d-4792-ac96-8b1053b167b5", "name": "network-vif-plugged", "status": "completed", "tag": "c9da782b-975b-4d78-bc93-092cf58fcf3a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:38.499380 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:38.500882 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:38.513760 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:38.514645 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:38.515421 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:38.516284 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:38.516825 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b95361fd-a4a2-44b6-8e44-3d8254470d09 req-6a862473-4bae-4e11-a96a-be85bc3df6d1 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:38.516945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:38.517431 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:38.518545 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b95361fd-a4a2-44b6-8e44-3d8254470d09 req-6a862473-4bae-4e11-a96a-be85bc3df6d1 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:38.519235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b95361fd-a4a2-44b6-8e44-3d8254470d09 req-6a862473-4bae-4e11-a96a-be85bc3df6d1 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:38.535416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b95361fd-a4a2-44b6-8e44-3d8254470d09 req-6a862473-4bae-4e11-a96a-be85bc3df6d1 service nova] Creating event network-vif-plugged:c9da782b-975b-4d78-bc93-092cf58fcf3a for instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 on hv-cinder-82002 Sep 08 13:54:38.542264 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b95361fd-a4a2-44b6-8e44-3d8254470d09 req-6a862473-4bae-4e11-a96a-be85bc3df6d1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056824 Sep 08 13:54:38.543424 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 161/315] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:38.551391 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-588e6cca-6e11-48d2-ba75-6beb1ecc17ae tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:38.552291 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-588e6cca-6e11-48d2-ba75-6beb1ecc17ae tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:38.560455 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-588e6cca-6e11-48d2-ba75-6beb1ecc17ae tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:38.561488 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-588e6cca-6e11-48d2-ba75-6beb1ecc17ae tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:38.561962 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-588e6cca-6e11-48d2-ba75-6beb1ecc17ae tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:38.562761 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-588e6cca-6e11-48d2-ba75-6beb1ecc17ae tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:38.563127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-588e6cca-6e11-48d2-ba75-6beb1ecc17ae tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:38.563548 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-588e6cca-6e11-48d2-ba75-6beb1ecc17ae tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:38.720569 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:38.728857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:38.730370 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:38.731504 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-55a539b0-fe1a-4f34-ad43-6f6366eacf18 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1406 microversion: 2.20 time: 0.244479 Sep 08 13:54:38.732631 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 155/316] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:38 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:38.751110 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-588e6cca-6e11-48d2-ba75-6beb1ecc17ae tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:38.758947 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-588e6cca-6e11-48d2-ba75-6beb1ecc17ae tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.214269 Sep 08 13:54:38.759521 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 162/317] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:38 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:39.275905 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b6d54340-6fd8-4c42-82a4-b730ed2633db tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:39.276514 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b6d54340-6fd8-4c42-82a4-b730ed2633db tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:39.282682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6d54340-6fd8-4c42-82a4-b730ed2633db tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:39.283172 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6d54340-6fd8-4c42-82a4-b730ed2633db tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:39.285580 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6d54340-6fd8-4c42-82a4-b730ed2633db tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:39.286347 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6d54340-6fd8-4c42-82a4-b730ed2633db tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:39.286874 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6d54340-6fd8-4c42-82a4-b730ed2633db tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:39.287370 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6d54340-6fd8-4c42-82a4-b730ed2633db tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:39.417061 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b6d54340-6fd8-4c42-82a4-b730ed2633db tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:39.424708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b6d54340-6fd8-4c42-82a4-b730ed2633db tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1507 microversion: 2.1 time: 0.152777 Sep 08 13:54:39.425270 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 156/318] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:39 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:39.757561 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:39.758275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:39.760927 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:39.766465 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:39.767014 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:39.767491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:39.768148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:39.768614 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:39.769026 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:39.784782 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7d9a8d82-4b6d-430a-bc15-0f561bb8e4a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:39.785466 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d9a8d82-4b6d-430a-bc15-0f561bb8e4a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:39.807673 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d9a8d82-4b6d-430a-bc15-0f561bb8e4a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:39.811392 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d9a8d82-4b6d-430a-bc15-0f561bb8e4a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:39.812091 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d9a8d82-4b6d-430a-bc15-0f561bb8e4a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:39.813050 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d9a8d82-4b6d-430a-bc15-0f561bb8e4a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:39.815501 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d9a8d82-4b6d-430a-bc15-0f561bb8e4a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:39.816185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d9a8d82-4b6d-430a-bc15-0f561bb8e4a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:39.964582 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:39.979877 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:39.981316 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:39.983019 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5e3e945c-680b-4286-8f71-754c95de72cc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1406 microversion: 2.20 time: 0.229647 Sep 08 13:54:39.983891 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 163/319] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:39 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:40.035411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7d9a8d82-4b6d-430a-bc15-0f561bb8e4a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:40.043953 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7d9a8d82-4b6d-430a-bc15-0f561bb8e4a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.263554 Sep 08 13:54:40.045296 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 157/320] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:39 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:41.011789 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:41.012382 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:41.019666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:41.020143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:41.020573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:41.021258 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:41.021704 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:41.022155 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:41.070269 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e14592bd-b12c-4283-a2d7-f0a5c0299560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:41.070874 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e14592bd-b12c-4283-a2d7-f0a5c0299560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:41.078730 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14592bd-b12c-4283-a2d7-f0a5c0299560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:41.079176 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14592bd-b12c-4283-a2d7-f0a5c0299560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:41.080046 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14592bd-b12c-4283-a2d7-f0a5c0299560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:41.081272 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14592bd-b12c-4283-a2d7-f0a5c0299560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:41.081751 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14592bd-b12c-4283-a2d7-f0a5c0299560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:41.082394 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e14592bd-b12c-4283-a2d7-f0a5c0299560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:41.223354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:41.235451 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:41.236932 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:41.238071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-587adef2-1890-4898-8623-164d32fbeee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1406 microversion: 2.20 time: 0.230150 Sep 08 13:54:41.238632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 164/321] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:41 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:41.243303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ca3a35c6-1881-401a-aaa0-4717401ad904 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "119f783b-ae2d-45b1-9631-5751172f3eb8"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:41.245964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ca3a35c6-1881-401a-aaa0-4717401ad904 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:41.251756 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ca3a35c6-1881-401a-aaa0-4717401ad904 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:41.252239 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ca3a35c6-1881-401a-aaa0-4717401ad904 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:41.252670 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ca3a35c6-1881-401a-aaa0-4717401ad904 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:41.253099 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e14592bd-b12c-4283-a2d7-f0a5c0299560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:41.253528 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ca3a35c6-1881-401a-aaa0-4717401ad904 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:41.254008 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ca3a35c6-1881-401a-aaa0-4717401ad904 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:41.254426 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ca3a35c6-1881-401a-aaa0-4717401ad904 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:41.261008 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e14592bd-b12c-4283-a2d7-f0a5c0299560 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.194644 Sep 08 13:54:41.261571 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 158/322] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:41 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:41.326358 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:42.262958 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:42.264133 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:42.270189 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:42.270668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:42.271102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:42.271786 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:42.272237 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:42.272659 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:42.406046 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:42.414249 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:42.415708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:42.416973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-607b2023-82f8-409e-9d3c-e8b42f89f6a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1598 microversion: 2.20 time: 0.157904 Sep 08 13:54:42.417533 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 159/323] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:54:42 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:54:42.421839 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28eb08cf-919b-4c14-ab63-3803e2db4d36 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:42.422438 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-28eb08cf-919b-4c14-ab63-3803e2db4d36 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:42.427959 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28eb08cf-919b-4c14-ab63-3803e2db4d36 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:42.428439 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28eb08cf-919b-4c14-ab63-3803e2db4d36 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:42.428870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28eb08cf-919b-4c14-ab63-3803e2db4d36 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:42.429554 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28eb08cf-919b-4c14-ab63-3803e2db4d36 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:42.430042 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28eb08cf-919b-4c14-ab63-3803e2db4d36 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:42.430457 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28eb08cf-919b-4c14-ab63-3803e2db4d36 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:42.567772 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-28eb08cf-919b-4c14-ab63-3803e2db4d36 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:42.575445 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28eb08cf-919b-4c14-ab63-3803e2db4d36 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.156933 Sep 08 13:54:42.576539 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 160/324] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:42 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:42.580984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-47a4c579-60bc-4d10-8a42-69137b74a464 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:42.581467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-47a4c579-60bc-4d10-8a42-69137b74a464 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:42.586845 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a4c579-60bc-4d10-8a42-69137b74a464 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:42.587579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a4c579-60bc-4d10-8a42-69137b74a464 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:42.588007 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a4c579-60bc-4d10-8a42-69137b74a464 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:42.588694 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a4c579-60bc-4d10-8a42-69137b74a464 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:42.589167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a4c579-60bc-4d10-8a42-69137b74a464 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:42.589590 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47a4c579-60bc-4d10-8a42-69137b74a464 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:42.664948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-47a4c579-60bc-4d10-8a42-69137b74a464 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087329 Sep 08 13:54:42.665543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 161/325] 10.222.0.55 () {60 vars in 1316 bytes} [Thu Sep 8 13:54:42 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:54:43.566133 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ca3a35c6-1881-401a-aaa0-4717401ad904 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "POST /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.326206 Sep 08 13:54:43.567860 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 165/326] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 13:54:41 2022] POST /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/os-volume_attachments => generated 194 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:43.603440 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-85836086-ad39-409f-bd3a-355f4f3a98f6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:43.604073 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-85836086-ad39-409f-bd3a-355f4f3a98f6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:43.611592 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85836086-ad39-409f-bd3a-355f4f3a98f6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:43.611945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85836086-ad39-409f-bd3a-355f4f3a98f6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:43.612299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85836086-ad39-409f-bd3a-355f4f3a98f6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:43.613375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85836086-ad39-409f-bd3a-355f4f3a98f6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:43.614011 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85836086-ad39-409f-bd3a-355f4f3a98f6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:43.615103 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85836086-ad39-409f-bd3a-355f4f3a98f6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:43.674956 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-2dda89a0-de9c-4a8c-ad7a-0262982cc8e8 req-40063ac8-c397-48d3-979d-b50f426d535b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efdb4c65-ed8d-4792-ac96-8b1053b167b5", "tag": "c9da782b-975b-4d78-bc93-092cf58fcf3a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:43.691383 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2dda89a0-de9c-4a8c-ad7a-0262982cc8e8 req-40063ac8-c397-48d3-979d-b50f426d535b service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:43.691784 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2dda89a0-de9c-4a8c-ad7a-0262982cc8e8 req-40063ac8-c397-48d3-979d-b50f426d535b service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:43.692215 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-2dda89a0-de9c-4a8c-ad7a-0262982cc8e8 req-40063ac8-c397-48d3-979d-b50f426d535b service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:43.704338 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-2dda89a0-de9c-4a8c-ad7a-0262982cc8e8 req-40063ac8-c397-48d3-979d-b50f426d535b service nova] Creating event network-changed:c9da782b-975b-4d78-bc93-092cf58fcf3a for instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 on hv-cinder-82002 Sep 08 13:54:43.709465 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-2dda89a0-de9c-4a8c-ad7a-0262982cc8e8 req-40063ac8-c397-48d3-979d-b50f426d535b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038467 Sep 08 13:54:43.710269 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 166/327] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:43.783526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-85836086-ad39-409f-bd3a-355f4f3a98f6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:43.792511 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-85836086-ad39-409f-bd3a-355f4f3a98f6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.196895 Sep 08 13:54:43.793505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 162/328] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:43 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:44.310744 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1483b6ac-b972-41b5-80a7-217b68a969ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:44.311634 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1483b6ac-b972-41b5-80a7-217b68a969ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:44.318757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1483b6ac-b972-41b5-80a7-217b68a969ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:44.319246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1483b6ac-b972-41b5-80a7-217b68a969ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:44.319678 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1483b6ac-b972-41b5-80a7-217b68a969ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:44.320482 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1483b6ac-b972-41b5-80a7-217b68a969ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:44.320955 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1483b6ac-b972-41b5-80a7-217b68a969ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:44.321378 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1483b6ac-b972-41b5-80a7-217b68a969ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:44.756661 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-1483b6ac-b972-41b5-80a7-217b68a969ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:44.765915 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1483b6ac-b972-41b5-80a7-217b68a969ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1594 microversion: 2.1 time: 0.460009 Sep 08 13:54:44.766619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 167/329] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:44 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1594 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:44.816965 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-774f42ed-0103-42d5-aeac-c2101db02c7e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:44.817587 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-774f42ed-0103-42d5-aeac-c2101db02c7e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:44.826451 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774f42ed-0103-42d5-aeac-c2101db02c7e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:44.826938 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774f42ed-0103-42d5-aeac-c2101db02c7e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:44.827376 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774f42ed-0103-42d5-aeac-c2101db02c7e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:44.828096 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774f42ed-0103-42d5-aeac-c2101db02c7e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:44.828544 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774f42ed-0103-42d5-aeac-c2101db02c7e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:44.828965 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774f42ed-0103-42d5-aeac-c2101db02c7e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:44.850268 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:44.979397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-774f42ed-0103-42d5-aeac-c2101db02c7e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:44.988154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-774f42ed-0103-42d5-aeac-c2101db02c7e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.175578 Sep 08 13:54:44.988717 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 163/330] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:44 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:46.014075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0be55a84-b17f-4e46-a192-e935fd411696 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:46.014590 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0be55a84-b17f-4e46-a192-e935fd411696 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:46.021510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be55a84-b17f-4e46-a192-e935fd411696 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:46.022017 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be55a84-b17f-4e46-a192-e935fd411696 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:46.022454 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be55a84-b17f-4e46-a192-e935fd411696 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:46.023150 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be55a84-b17f-4e46-a192-e935fd411696 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:46.023598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be55a84-b17f-4e46-a192-e935fd411696 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:46.024014 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0be55a84-b17f-4e46-a192-e935fd411696 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:46.161260 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0be55a84-b17f-4e46-a192-e935fd411696 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:46.169013 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0be55a84-b17f-4e46-a192-e935fd411696 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.158958 Sep 08 13:54:46.169616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 168/331] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:46 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:46.871911 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1d56862d-e06d-4145-ba82-5d1ada1058d4 req-3b7f6cbf-0f2c-4f40-8088-6cac94da10fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e64a0c9-b7b0-46ff-8526-88164d493140", "tag": "ca4283b0-e159-4a24-b0b2-bc113ff78694"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:46.882257 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1d56862d-e06d-4145-ba82-5d1ada1058d4 req-3b7f6cbf-0f2c-4f40-8088-6cac94da10fc service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:46.882731 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1d56862d-e06d-4145-ba82-5d1ada1058d4 req-3b7f6cbf-0f2c-4f40-8088-6cac94da10fc service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:46.883162 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1d56862d-e06d-4145-ba82-5d1ada1058d4 req-3b7f6cbf-0f2c-4f40-8088-6cac94da10fc service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:46.897257 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1d56862d-e06d-4145-ba82-5d1ada1058d4 req-3b7f6cbf-0f2c-4f40-8088-6cac94da10fc service nova] Creating event network-changed:ca4283b0-e159-4a24-b0b2-bc113ff78694 for instance 6e64a0c9-b7b0-46ff-8526-88164d493140 on hv-cinder-82002 Sep 08 13:54:46.904160 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1d56862d-e06d-4145-ba82-5d1ada1058d4 req-3b7f6cbf-0f2c-4f40-8088-6cac94da10fc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035960 Sep 08 13:54:46.905653 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 164/332] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:47.192839 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-28815b8c-b1d9-4a3e-bde4-0bbc824ed298 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:47.199678 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-28815b8c-b1d9-4a3e-bde4-0bbc824ed298 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:47.222596 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28815b8c-b1d9-4a3e-bde4-0bbc824ed298 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:47.223793 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28815b8c-b1d9-4a3e-bde4-0bbc824ed298 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:47.225376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28815b8c-b1d9-4a3e-bde4-0bbc824ed298 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:47.226342 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28815b8c-b1d9-4a3e-bde4-0bbc824ed298 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:47.226955 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28815b8c-b1d9-4a3e-bde4-0bbc824ed298 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:47.227599 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28815b8c-b1d9-4a3e-bde4-0bbc824ed298 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:47.548753 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-28815b8c-b1d9-4a3e-bde4-0bbc824ed298 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:47.556995 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-28815b8c-b1d9-4a3e-bde4-0bbc824ed298 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.368924 Sep 08 13:54:47.573074 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 169/333] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:47 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:47.964758 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-403294ac-f426-413b-a7c4-c7bf53fdf836 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1678122210"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:47.965405 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-403294ac-f426-413b-a7c4-c7bf53fdf836 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:47.975174 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-403294ac-f426-413b-a7c4-c7bf53fdf836 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:47.975770 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-403294ac-f426-413b-a7c4-c7bf53fdf836 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:47.976416 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-403294ac-f426-413b-a7c4-c7bf53fdf836 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:47.977220 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-403294ac-f426-413b-a7c4-c7bf53fdf836 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:47.977720 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-403294ac-f426-413b-a7c4-c7bf53fdf836 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:47.978172 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-403294ac-f426-413b-a7c4-c7bf53fdf836 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:48.125910 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.network.security_group_api [None req-403294ac-f426-413b-a7c4-c7bf53fdf836 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Adding security group 0f1e5d94-1b7b-4090-9ab1-0f2f3a565a55 to port ca4283b0-e159-4a24-b0b2-bc113ff78694 Sep 08 13:54:48.472597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-403294ac-f426-413b-a7c4-c7bf53fdf836 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "POST /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/action" status: 202 len: 0 microversion: 2.1 time: 0.512538 Sep 08 13:54:48.473229 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 165/334] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:54:47 2022] POST /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:54:48.481351 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0c54b7ef-bb12-467a-aefe-4c49e2910b5e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:48.482004 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0c54b7ef-bb12-467a-aefe-4c49e2910b5e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:48.487241 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1e712677-a836-4f4c-87fa-e376169baec9 req-b8d531f4-4bf4-4f96-b914-0753b6d18ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e64a0c9-b7b0-46ff-8526-88164d493140", "tag": "ca4283b0-e159-4a24-b0b2-bc113ff78694"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:48.496750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1e712677-a836-4f4c-87fa-e376169baec9 req-b8d531f4-4bf4-4f96-b914-0753b6d18ad1 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:48.498505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1e712677-a836-4f4c-87fa-e376169baec9 req-b8d531f4-4bf4-4f96-b914-0753b6d18ad1 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:48.498505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1e712677-a836-4f4c-87fa-e376169baec9 req-b8d531f4-4bf4-4f96-b914-0753b6d18ad1 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:48.500164 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c54b7ef-bb12-467a-aefe-4c49e2910b5e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:48.500646 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c54b7ef-bb12-467a-aefe-4c49e2910b5e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:48.501079 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c54b7ef-bb12-467a-aefe-4c49e2910b5e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:48.501873 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c54b7ef-bb12-467a-aefe-4c49e2910b5e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:48.502482 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c54b7ef-bb12-467a-aefe-4c49e2910b5e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:48.503062 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0c54b7ef-bb12-467a-aefe-4c49e2910b5e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:48.510608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1e712677-a836-4f4c-87fa-e376169baec9 req-b8d531f4-4bf4-4f96-b914-0753b6d18ad1 service nova] Creating event network-changed:ca4283b0-e159-4a24-b0b2-bc113ff78694 for instance 6e64a0c9-b7b0-46ff-8526-88164d493140 on hv-cinder-82002 Sep 08 13:54:48.517194 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1e712677-a836-4f4c-87fa-e376169baec9 req-b8d531f4-4bf4-4f96-b914-0753b6d18ad1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033338 Sep 08 13:54:48.518065 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 166/335] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:48.581018 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f5d5d84-27e5-42b0-a5b6-07fda9f60eef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:48.581720 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f5d5d84-27e5-42b0-a5b6-07fda9f60eef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:48.588084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f5d5d84-27e5-42b0-a5b6-07fda9f60eef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:48.588571 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f5d5d84-27e5-42b0-a5b6-07fda9f60eef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:48.589007 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f5d5d84-27e5-42b0-a5b6-07fda9f60eef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:48.589708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f5d5d84-27e5-42b0-a5b6-07fda9f60eef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:48.590188 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f5d5d84-27e5-42b0-a5b6-07fda9f60eef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:48.590606 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f5d5d84-27e5-42b0-a5b6-07fda9f60eef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:48.751473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0c54b7ef-bb12-467a-aefe-4c49e2910b5e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:48.760515 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0c54b7ef-bb12-467a-aefe-4c49e2910b5e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1759 microversion: 2.1 time: 0.282917 Sep 08 13:54:48.778026 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 170/336] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:48 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1759 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:48.855850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3f5d5d84-27e5-42b0-a5b6-07fda9f60eef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:48.865117 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f5d5d84-27e5-42b0-a5b6-07fda9f60eef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.288241 Sep 08 13:54:48.865880 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 167/337] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:48 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:49.892598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b829e15f-450e-4f38-a1cc-0ab0813e8692 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:49.893279 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b829e15f-450e-4f38-a1cc-0ab0813e8692 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:49.902704 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b829e15f-450e-4f38-a1cc-0ab0813e8692 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:49.903201 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b829e15f-450e-4f38-a1cc-0ab0813e8692 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:49.903642 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b829e15f-450e-4f38-a1cc-0ab0813e8692 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:49.904450 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b829e15f-450e-4f38-a1cc-0ab0813e8692 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:49.904924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b829e15f-450e-4f38-a1cc-0ab0813e8692 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:49.905350 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b829e15f-450e-4f38-a1cc-0ab0813e8692 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:50.041583 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b829e15f-450e-4f38-a1cc-0ab0813e8692 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:50.049691 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b829e15f-450e-4f38-a1cc-0ab0813e8692 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.163139 Sep 08 13:54:50.050285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 171/338] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:49 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:51.072252 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5bc3f417-a0e2-44ea-a7ea-60f2bbf5b6c9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:51.072890 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5bc3f417-a0e2-44ea-a7ea-60f2bbf5b6c9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:51.078963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc3f417-a0e2-44ea-a7ea-60f2bbf5b6c9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:51.079446 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc3f417-a0e2-44ea-a7ea-60f2bbf5b6c9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:51.079884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc3f417-a0e2-44ea-a7ea-60f2bbf5b6c9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:51.080573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc3f417-a0e2-44ea-a7ea-60f2bbf5b6c9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:51.081023 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc3f417-a0e2-44ea-a7ea-60f2bbf5b6c9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:51.081512 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bc3f417-a0e2-44ea-a7ea-60f2bbf5b6c9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:51.212962 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5bc3f417-a0e2-44ea-a7ea-60f2bbf5b6c9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:51.221264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5bc3f417-a0e2-44ea-a7ea-60f2bbf5b6c9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.152857 Sep 08 13:54:51.221849 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 168/339] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:51 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:52.205712 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2ae1aba9-9a0c-469b-b6a8-0687b3ed1b21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: .version_select at 0x7f5be449bd30>, body: {"keypair": {"name": "tempest-keypair-297537427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWmFGMeuvrfJCR9THDt7GffRjBj5EsK3qdKHljgzVLtaNfPNGJNlUUHbgahet/1AhyE0Cjs+ggNNWZfnrsCRDLILeQ8uemoHjjeG3okIu4YimgOLoGjqoBy4c7LVgJ7XQ=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:52.222324 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-2ae1aba9-9a0c-469b-b6a8-0687b3ed1b21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for project b4ca185497284e9780eba8fc2e713d6e. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:54:52.226283 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-2ae1aba9-9a0c-469b-b6a8-0687b3ed1b21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for user 2e48a8c1b91142cf9d1af17f28e41961 and project b4ca185497284e9780eba8fc2e713d6e. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:54:52.244066 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ccfd266-cfab-4cb0-982d-e644fd32f3b5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:52.245708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ccfd266-cfab-4cb0-982d-e644fd32f3b5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:52.251604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2ae1aba9-9a0c-469b-b6a8-0687b3ed1b21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049764 Sep 08 13:54:52.252218 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 172/340] 10.222.0.55 () {60 vars in 1159 bytes} [Thu Sep 8 13:54:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:52.253070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfd266-cfab-4cb0-982d-e644fd32f3b5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:52.253558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfd266-cfab-4cb0-982d-e644fd32f3b5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:52.254099 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfd266-cfab-4cb0-982d-e644fd32f3b5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:52.254825 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfd266-cfab-4cb0-982d-e644fd32f3b5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:52.255432 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfd266-cfab-4cb0-982d-e644fd32f3b5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:52.256434 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ccfd266-cfab-4cb0-982d-e644fd32f3b5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:52.462109 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ccfd266-cfab-4cb0-982d-e644fd32f3b5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:52.472752 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ccfd266-cfab-4cb0-982d-e644fd32f3b5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.230708 Sep 08 13:54:52.472752 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 169/341] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:52 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:53.494875 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ec5109df-320b-4ea8-929b-78831cad2850 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:53.496066 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ec5109df-320b-4ea8-929b-78831cad2850 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:53.503656 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec5109df-320b-4ea8-929b-78831cad2850 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:53.504219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec5109df-320b-4ea8-929b-78831cad2850 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:53.504653 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec5109df-320b-4ea8-929b-78831cad2850 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:53.505407 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec5109df-320b-4ea8-929b-78831cad2850 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:53.505918 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec5109df-320b-4ea8-929b-78831cad2850 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:53.506343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec5109df-320b-4ea8-929b-78831cad2850 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:53.670119 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ec5109df-320b-4ea8-929b-78831cad2850 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:53.678587 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ec5109df-320b-4ea8-929b-78831cad2850 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.187664 Sep 08 13:54:53.679162 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 173/342] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:53 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:53.730721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1962726885", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf5901ef-2ee5-4879-85aa-18770c77b80a"}], "security_groups": [{"name": "tempest-securitygroup--1895141142"}], "key_name": "tempest-keypair-297537427", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:53.974838 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] validate_networks() for [('cf5901ef-2ee5-4879-85aa-18770c77b80a', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:54:54.353433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:54:54.353988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:54:54.354349 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:54:54.355274 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:54:54.355720 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:54:54.364633 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:54.365143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:54.365576 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:54.366339 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:54.366796 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:54.367222 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:54.384631 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for project b4ca185497284e9780eba8fc2e713d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:54:54.389240 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for user 2e48a8c1b91142cf9d1af17f28e41961 and project b4ca185497284e9780eba8fc2e713d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:54:54.400323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:54:54.402689 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:54:54.452557 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-808a2421-5a0d-4e60-bdc9-22291d3b3f08 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.725999 Sep 08 13:54:54.453199 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 170/343] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:54:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:54:54.464403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c271450b-9e92-4d19-bc36-aa9c1cbbe181 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:54.465021 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c271450b-9e92-4d19-bc36-aa9c1cbbe181 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:54.519755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c271450b-9e92-4d19-bc36-aa9c1cbbe181 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:54.527897 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c271450b-9e92-4d19-bc36-aa9c1cbbe181 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1241 microversion: 2.1 time: 0.067516 Sep 08 13:54:54.528498 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 174/344] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:54 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:54.700925 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f87ae8e8-0d74-4b52-b0e8-f610691b0d39 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:54.701529 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f87ae8e8-0d74-4b52-b0e8-f610691b0d39 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:54.707994 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e8-0d74-4b52-b0e8-f610691b0d39 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:54.708480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e8-0d74-4b52-b0e8-f610691b0d39 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:54.708915 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e8-0d74-4b52-b0e8-f610691b0d39 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:54.709609 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e8-0d74-4b52-b0e8-f610691b0d39 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:54.714267 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e8-0d74-4b52-b0e8-f610691b0d39 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:54.714719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f87ae8e8-0d74-4b52-b0e8-f610691b0d39 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:54.858800 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f87ae8e8-0d74-4b52-b0e8-f610691b0d39 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:54.866665 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f87ae8e8-0d74-4b52-b0e8-f610691b0d39 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.170138 Sep 08 13:54:54.867217 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 171/345] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:54 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:55.550059 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-34f77a03-19a8-480e-9e9f-95772d874243 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:55.550741 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-34f77a03-19a8-480e-9e9f-95772d874243 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:55.558146 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f77a03-19a8-480e-9e9f-95772d874243 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:55.558657 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f77a03-19a8-480e-9e9f-95772d874243 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:55.559167 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f77a03-19a8-480e-9e9f-95772d874243 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:55.560460 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f77a03-19a8-480e-9e9f-95772d874243 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:55.560912 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f77a03-19a8-480e-9e9f-95772d874243 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:55.561335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-34f77a03-19a8-480e-9e9f-95772d874243 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:55.623325 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-34f77a03-19a8-480e-9e9f-95772d874243 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:55.630801 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-34f77a03-19a8-480e-9e9f-95772d874243 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1293 microversion: 2.1 time: 0.084552 Sep 08 13:54:55.631359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 175/346] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:55 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:55.889478 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c8de1c7d-f1ae-4c0f-8a51-f42205492007 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:55.890116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c8de1c7d-f1ae-4c0f-8a51-f42205492007 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:55.896426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8de1c7d-f1ae-4c0f-8a51-f42205492007 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:55.896909 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8de1c7d-f1ae-4c0f-8a51-f42205492007 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:55.897345 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8de1c7d-f1ae-4c0f-8a51-f42205492007 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:55.898074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8de1c7d-f1ae-4c0f-8a51-f42205492007 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:55.898534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8de1c7d-f1ae-4c0f-8a51-f42205492007 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:55.898963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8de1c7d-f1ae-4c0f-8a51-f42205492007 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:56.040438 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c8de1c7d-f1ae-4c0f-8a51-f42205492007 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:56.051227 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c8de1c7d-f1ae-4c0f-8a51-f42205492007 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.165553 Sep 08 13:54:56.052143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 172/347] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:55 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:56.654077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-657a8ac2-f9a0-433d-8064-3f3982977980 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:56.654693 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-657a8ac2-f9a0-433d-8064-3f3982977980 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:56.661068 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-657a8ac2-f9a0-433d-8064-3f3982977980 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:56.661543 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-657a8ac2-f9a0-433d-8064-3f3982977980 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:56.662003 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-657a8ac2-f9a0-433d-8064-3f3982977980 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:56.662685 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-657a8ac2-f9a0-433d-8064-3f3982977980 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:56.663134 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-657a8ac2-f9a0-433d-8064-3f3982977980 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:56.663546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-657a8ac2-f9a0-433d-8064-3f3982977980 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:56.728007 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-657a8ac2-f9a0-433d-8064-3f3982977980 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:56.735440 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-657a8ac2-f9a0-433d-8064-3f3982977980 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1299 microversion: 2.1 time: 0.085271 Sep 08 13:54:56.736008 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 176/348] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:56 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:57.075398 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-808d349c-3e5b-4bb3-9cb2-aa94395be35e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:57.076026 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-808d349c-3e5b-4bb3-9cb2-aa94395be35e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:57.082175 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808d349c-3e5b-4bb3-9cb2-aa94395be35e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:57.082670 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808d349c-3e5b-4bb3-9cb2-aa94395be35e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:57.083111 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808d349c-3e5b-4bb3-9cb2-aa94395be35e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:57.083819 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808d349c-3e5b-4bb3-9cb2-aa94395be35e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:57.084273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808d349c-3e5b-4bb3-9cb2-aa94395be35e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:57.084691 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-808d349c-3e5b-4bb3-9cb2-aa94395be35e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:57.356360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-808d349c-3e5b-4bb3-9cb2-aa94395be35e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:57.364438 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-808d349c-3e5b-4bb3-9cb2-aa94395be35e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.293132 Sep 08 13:54:57.364996 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 173/349] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:57 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:57.759443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20351f19-1450-44a4-bbf6-ca2cf518a398 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:57.760070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-20351f19-1450-44a4-bbf6-ca2cf518a398 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:57.766879 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20351f19-1450-44a4-bbf6-ca2cf518a398 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:57.767502 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20351f19-1450-44a4-bbf6-ca2cf518a398 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:57.768006 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20351f19-1450-44a4-bbf6-ca2cf518a398 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:57.768770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20351f19-1450-44a4-bbf6-ca2cf518a398 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:57.769292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20351f19-1450-44a4-bbf6-ca2cf518a398 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:57.769716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20351f19-1450-44a4-bbf6-ca2cf518a398 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:57.964312 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-20351f19-1450-44a4-bbf6-ca2cf518a398 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:57.972902 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-20351f19-1450-44a4-bbf6-ca2cf518a398 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.217374 Sep 08 13:54:57.973503 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 177/350] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:57 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:58.267318 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c609dd06-5b94-465c-84f4-dcfbff74da67 req-8351bb47-bd91-44a1-9070-116b5331606d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959f81c9-4c88-41e0-8eb9-e5b3fb5faa32", "tag": "c56674e2-ad46-43bc-9f41-cf0a4987597f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:58.276842 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c609dd06-5b94-465c-84f4-dcfbff74da67 req-8351bb47-bd91-44a1-9070-116b5331606d service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:58.277321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c609dd06-5b94-465c-84f4-dcfbff74da67 req-8351bb47-bd91-44a1-9070-116b5331606d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:58.277756 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c609dd06-5b94-465c-84f4-dcfbff74da67 req-8351bb47-bd91-44a1-9070-116b5331606d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:58.288276 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c609dd06-5b94-465c-84f4-dcfbff74da67 req-8351bb47-bd91-44a1-9070-116b5331606d service nova] Creating event network-changed:c56674e2-ad46-43bc-9f41-cf0a4987597f for instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 on hv-cinder-82002 Sep 08 13:54:58.293078 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c609dd06-5b94-465c-84f4-dcfbff74da67 req-8351bb47-bd91-44a1-9070-116b5331606d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030057 Sep 08 13:54:58.293651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 174/351] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:58.387409 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-15d1c00d-bfee-434e-a1e4-52af7ac0bb73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:58.388024 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-15d1c00d-bfee-434e-a1e4-52af7ac0bb73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:58.393955 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1c00d-bfee-434e-a1e4-52af7ac0bb73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:58.394434 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1c00d-bfee-434e-a1e4-52af7ac0bb73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:58.394867 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1c00d-bfee-434e-a1e4-52af7ac0bb73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:58.395549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1c00d-bfee-434e-a1e4-52af7ac0bb73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:58.396001 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1c00d-bfee-434e-a1e4-52af7ac0bb73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:58.396423 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-15d1c00d-bfee-434e-a1e4-52af7ac0bb73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:58.570233 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-15d1c00d-bfee-434e-a1e4-52af7ac0bb73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:58.581867 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-15d1c00d-bfee-434e-a1e4-52af7ac0bb73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.198225 Sep 08 13:54:58.582510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 178/352] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:58 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:58.995710 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c2d142de-ee1b-4aee-845d-c8f576236764 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:58.996415 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c2d142de-ee1b-4aee-845d-c8f576236764 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:59.003101 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d142de-ee1b-4aee-845d-c8f576236764 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:59.003583 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d142de-ee1b-4aee-845d-c8f576236764 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:59.004021 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d142de-ee1b-4aee-845d-c8f576236764 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:59.004715 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d142de-ee1b-4aee-845d-c8f576236764 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:59.005165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d142de-ee1b-4aee-845d-c8f576236764 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:59.005590 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c2d142de-ee1b-4aee-845d-c8f576236764 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:59.188436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c2d142de-ee1b-4aee-845d-c8f576236764 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:59.197002 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c2d142de-ee1b-4aee-845d-c8f576236764 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.205447 Sep 08 13:54:59.210006 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 175/353] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:58 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:59.607866 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-492a5f74-a638-4d54-a13c-0a1bef34681a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:59.608475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-492a5f74-a638-4d54-a13c-0a1bef34681a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:59.614815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-492a5f74-a638-4d54-a13c-0a1bef34681a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:59.615296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-492a5f74-a638-4d54-a13c-0a1bef34681a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:59.615728 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-492a5f74-a638-4d54-a13c-0a1bef34681a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:59.616415 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-492a5f74-a638-4d54-a13c-0a1bef34681a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:59.616869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-492a5f74-a638-4d54-a13c-0a1bef34681a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:59.617293 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-492a5f74-a638-4d54-a13c-0a1bef34681a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:59.759414 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-492a5f74-a638-4d54-a13c-0a1bef34681a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:59.760232 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1b1329fc-7755-4a77-b116-e3983491a829 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:59.762232 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:59.767251 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b1329fc-7755-4a77-b116-e3983491a829 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:59.767662 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-492a5f74-a638-4d54-a13c-0a1bef34681a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.164222 Sep 08 13:54:59.767770 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b1329fc-7755-4a77-b116-e3983491a829 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:59.768142 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b1329fc-7755-4a77-b116-e3983491a829 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:59.768254 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 179/354] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:59 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:59.837927 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1b1329fc-7755-4a77-b116-e3983491a829 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Going to try to stop instance {{(pid=126920) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 13:54:59.879656 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1b1329fc-7755-4a77-b116-e3983491a829 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "POST /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/action" status: 202 len: 0 microversion: 2.1 time: 0.123061 Sep 08 13:54:59.880241 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 176/355] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:54:59 2022] POST /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:54:59.888704 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-16869d0f-f659-4f4b-b206-98ddecc62429 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:59.889321 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-16869d0f-f659-4f4b-b206-98ddecc62429 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:59.895104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16869d0f-f659-4f4b-b206-98ddecc62429 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:59.895581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16869d0f-f659-4f4b-b206-98ddecc62429 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:59.896004 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16869d0f-f659-4f4b-b206-98ddecc62429 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:59.896709 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16869d0f-f659-4f4b-b206-98ddecc62429 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:59.897156 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16869d0f-f659-4f4b-b206-98ddecc62429 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:59.897571 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-16869d0f-f659-4f4b-b206-98ddecc62429 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:00.025765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-16869d0f-f659-4f4b-b206-98ddecc62429 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:00.034440 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-16869d0f-f659-4f4b-b206-98ddecc62429 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.149955 Sep 08 13:55:00.035367 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 180/356] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:59 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:00.221038 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-126ae5e1-b82c-49c9-a22c-9066cb0186d2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:00.221760 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-126ae5e1-b82c-49c9-a22c-9066cb0186d2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:00.227842 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-126ae5e1-b82c-49c9-a22c-9066cb0186d2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:00.228323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-126ae5e1-b82c-49c9-a22c-9066cb0186d2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:00.228758 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-126ae5e1-b82c-49c9-a22c-9066cb0186d2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:00.229447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-126ae5e1-b82c-49c9-a22c-9066cb0186d2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:00.229940 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-126ae5e1-b82c-49c9-a22c-9066cb0186d2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:00.230365 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-126ae5e1-b82c-49c9-a22c-9066cb0186d2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:00.365132 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-126ae5e1-b82c-49c9-a22c-9066cb0186d2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:00.373560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-126ae5e1-b82c-49c9-a22c-9066cb0186d2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.157141 Sep 08 13:55:00.374211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 177/357] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:00 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:00.791325 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4cc449f8-0e33-45f5-9739-ce952e623b97 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:00.792059 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4cc449f8-0e33-45f5-9739-ce952e623b97 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:00.798647 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cc449f8-0e33-45f5-9739-ce952e623b97 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:00.799131 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cc449f8-0e33-45f5-9739-ce952e623b97 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:00.799566 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cc449f8-0e33-45f5-9739-ce952e623b97 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:00.800258 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cc449f8-0e33-45f5-9739-ce952e623b97 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:00.800714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cc449f8-0e33-45f5-9739-ce952e623b97 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:00.801167 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4cc449f8-0e33-45f5-9739-ce952e623b97 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:00.933775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-4cc449f8-0e33-45f5-9739-ce952e623b97 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:00.942532 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4cc449f8-0e33-45f5-9739-ce952e623b97 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.155047 Sep 08 13:55:00.943113 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 181/358] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:00 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:01.056910 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-105302d1-1baf-4e57-b71f-80a941d41433 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:01.057435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-105302d1-1baf-4e57-b71f-80a941d41433 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:01.063951 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-105302d1-1baf-4e57-b71f-80a941d41433 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:01.064461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-105302d1-1baf-4e57-b71f-80a941d41433 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:01.064886 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-105302d1-1baf-4e57-b71f-80a941d41433 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:01.065565 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-105302d1-1baf-4e57-b71f-80a941d41433 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:01.066042 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-105302d1-1baf-4e57-b71f-80a941d41433 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:01.066462 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-105302d1-1baf-4e57-b71f-80a941d41433 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:01.203293 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-105302d1-1baf-4e57-b71f-80a941d41433 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:01.212779 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-105302d1-1baf-4e57-b71f-80a941d41433 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.159471 Sep 08 13:55:01.213359 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 178/359] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:01 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:01.396491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-35b86710-04c6-4206-a3b4-a4dc420bf6ae tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:01.397129 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-35b86710-04c6-4206-a3b4-a4dc420bf6ae tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:01.403080 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35b86710-04c6-4206-a3b4-a4dc420bf6ae tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:01.403554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35b86710-04c6-4206-a3b4-a4dc420bf6ae tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:01.403980 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35b86710-04c6-4206-a3b4-a4dc420bf6ae tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:01.404661 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35b86710-04c6-4206-a3b4-a4dc420bf6ae tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:01.405126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35b86710-04c6-4206-a3b4-a4dc420bf6ae tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:01.405529 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-35b86710-04c6-4206-a3b4-a4dc420bf6ae tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:01.599597 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-35b86710-04c6-4206-a3b4-a4dc420bf6ae tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:01.607887 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-35b86710-04c6-4206-a3b4-a4dc420bf6ae tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.215194 Sep 08 13:55:01.608458 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 182/360] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:01 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:01.965619 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57e18060-6c75-43b2-ad64-1164c607e974 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:01.966190 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-57e18060-6c75-43b2-ad64-1164c607e974 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:01.972165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57e18060-6c75-43b2-ad64-1164c607e974 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:01.972643 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57e18060-6c75-43b2-ad64-1164c607e974 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:01.973076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57e18060-6c75-43b2-ad64-1164c607e974 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:01.973784 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57e18060-6c75-43b2-ad64-1164c607e974 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:01.974243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57e18060-6c75-43b2-ad64-1164c607e974 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:01.974663 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57e18060-6c75-43b2-ad64-1164c607e974 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:02.105352 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-57e18060-6c75-43b2-ad64-1164c607e974 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:02.113678 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-57e18060-6c75-43b2-ad64-1164c607e974 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.152225 Sep 08 13:55:02.114275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 179/361] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:01 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:02.235441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f8ba713-0b4f-447b-9202-001ae5f0c42c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:02.235996 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f8ba713-0b4f-447b-9202-001ae5f0c42c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:02.241987 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8ba713-0b4f-447b-9202-001ae5f0c42c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:02.242482 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8ba713-0b4f-447b-9202-001ae5f0c42c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:02.242895 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8ba713-0b4f-447b-9202-001ae5f0c42c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:02.243596 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8ba713-0b4f-447b-9202-001ae5f0c42c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:02.244031 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8ba713-0b4f-447b-9202-001ae5f0c42c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:02.244448 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f8ba713-0b4f-447b-9202-001ae5f0c42c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:02.372338 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6f8ba713-0b4f-447b-9202-001ae5f0c42c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:02.375830 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:02.381692 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f8ba713-0b4f-447b-9202-001ae5f0c42c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.150254 Sep 08 13:55:02.382288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 183/362] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:02 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:02.631474 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4746fe2b-d9b0-4e76-bf53-f6e08dff7c57 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:02.632107 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4746fe2b-d9b0-4e76-bf53-f6e08dff7c57 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:02.638618 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4746fe2b-d9b0-4e76-bf53-f6e08dff7c57 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:02.639092 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4746fe2b-d9b0-4e76-bf53-f6e08dff7c57 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:02.639519 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4746fe2b-d9b0-4e76-bf53-f6e08dff7c57 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:02.640194 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4746fe2b-d9b0-4e76-bf53-f6e08dff7c57 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:02.640638 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4746fe2b-d9b0-4e76-bf53-f6e08dff7c57 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:02.641053 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4746fe2b-d9b0-4e76-bf53-f6e08dff7c57 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:02.765491 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4746fe2b-d9b0-4e76-bf53-f6e08dff7c57 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:02.772936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4746fe2b-d9b0-4e76-bf53-f6e08dff7c57 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.145352 Sep 08 13:55:02.773521 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 180/363] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:02 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:03.137088 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b455f2b5-4999-4d6a-8daf-b8fa6b953325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:03.137693 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b455f2b5-4999-4d6a-8daf-b8fa6b953325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:03.144392 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b455f2b5-4999-4d6a-8daf-b8fa6b953325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:03.144874 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b455f2b5-4999-4d6a-8daf-b8fa6b953325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:03.145303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b455f2b5-4999-4d6a-8daf-b8fa6b953325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:03.146014 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b455f2b5-4999-4d6a-8daf-b8fa6b953325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:03.146470 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b455f2b5-4999-4d6a-8daf-b8fa6b953325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:03.146888 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b455f2b5-4999-4d6a-8daf-b8fa6b953325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:03.274998 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b455f2b5-4999-4d6a-8daf-b8fa6b953325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:03.282584 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b455f2b5-4999-4d6a-8daf-b8fa6b953325 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.150163 Sep 08 13:55:03.283133 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 184/364] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:03 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:03.405584 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1661bc6f-1e2c-45be-ae39-f0fea62ef36a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:03.406245 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1661bc6f-1e2c-45be-ae39-f0fea62ef36a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:03.412383 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1661bc6f-1e2c-45be-ae39-f0fea62ef36a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:03.412865 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1661bc6f-1e2c-45be-ae39-f0fea62ef36a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:03.413299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1661bc6f-1e2c-45be-ae39-f0fea62ef36a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:03.414193 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1661bc6f-1e2c-45be-ae39-f0fea62ef36a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:03.414650 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1661bc6f-1e2c-45be-ae39-f0fea62ef36a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:03.415064 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1661bc6f-1e2c-45be-ae39-f0fea62ef36a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:03.552029 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1661bc6f-1e2c-45be-ae39-f0fea62ef36a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:03.559913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1661bc6f-1e2c-45be-ae39-f0fea62ef36a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.158187 Sep 08 13:55:03.560464 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 181/365] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:03 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:03.795295 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3cda7080-0e6f-49e4-8889-c4528f25ce20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:03.795872 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3cda7080-0e6f-49e4-8889-c4528f25ce20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:03.801753 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cda7080-0e6f-49e4-8889-c4528f25ce20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:03.802253 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cda7080-0e6f-49e4-8889-c4528f25ce20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:03.802685 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cda7080-0e6f-49e4-8889-c4528f25ce20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:03.803367 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cda7080-0e6f-49e4-8889-c4528f25ce20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:03.803819 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cda7080-0e6f-49e4-8889-c4528f25ce20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:03.804239 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3cda7080-0e6f-49e4-8889-c4528f25ce20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:03.934020 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3cda7080-0e6f-49e4-8889-c4528f25ce20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:03.941846 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3cda7080-0e6f-49e4-8889-c4528f25ce20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.150469 Sep 08 13:55:03.942414 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 185/366] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:03 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:04.287905 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-099cd475-86c5-4134-9a56-5a9e8f2a1f95 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8005484-e4aa-43c3-9993-f530e0c9111c", "device": "/dev/sdb"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:04.290855 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-099cd475-86c5-4134-9a56-5a9e8f2a1f95 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:04.298003 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-099cd475-86c5-4134-9a56-5a9e8f2a1f95 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.299862 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-099cd475-86c5-4134-9a56-5a9e8f2a1f95 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.299862 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-099cd475-86c5-4134-9a56-5a9e8f2a1f95 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:04.300064 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-099cd475-86c5-4134-9a56-5a9e8f2a1f95 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.300707 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-099cd475-86c5-4134-9a56-5a9e8f2a1f95 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.301469 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-099cd475-86c5-4134-9a56-5a9e8f2a1f95 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:04.305281 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0d5959d-d3c8-4b57-952e-9cb3e6f14bfb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:04.305792 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:04.306288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c0d5959d-d3c8-4b57-952e-9cb3e6f14bfb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:04.308960 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:04.315891 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0d5959d-d3c8-4b57-952e-9cb3e6f14bfb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.316377 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0d5959d-d3c8-4b57-952e-9cb3e6f14bfb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.316806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0d5959d-d3c8-4b57-952e-9cb3e6f14bfb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:04.317769 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0d5959d-d3c8-4b57-952e-9cb3e6f14bfb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.318409 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0d5959d-d3c8-4b57-952e-9cb3e6f14bfb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.318832 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0d5959d-d3c8-4b57-952e-9cb3e6f14bfb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:04.376650 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:04.398342 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:04.457552 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c0d5959d-d3c8-4b57-952e-9cb3e6f14bfb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:04.465920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0d5959d-d3c8-4b57-952e-9cb3e6f14bfb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.164378 Sep 08 13:55:04.466486 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 186/367] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:04 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:04.584555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-811540e0-5c5b-4bfd-a4b5-d126a7219505 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:04.585557 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-811540e0-5c5b-4bfd-a4b5-d126a7219505 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:04.587717 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:04.592842 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-811540e0-5c5b-4bfd-a4b5-d126a7219505 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.593432 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-811540e0-5c5b-4bfd-a4b5-d126a7219505 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.593893 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-811540e0-5c5b-4bfd-a4b5-d126a7219505 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:04.594688 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-811540e0-5c5b-4bfd-a4b5-d126a7219505 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.595217 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-811540e0-5c5b-4bfd-a4b5-d126a7219505 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.595633 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-811540e0-5c5b-4bfd-a4b5-d126a7219505 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:04.723301 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-811540e0-5c5b-4bfd-a4b5-d126a7219505 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:04.732047 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-811540e0-5c5b-4bfd-a4b5-d126a7219505 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.151170 Sep 08 13:55:04.732634 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 187/368] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:04 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:04.966360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bfd4c300-0c55-455c-af12-2cf04dadc83d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:04.966988 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bfd4c300-0c55-455c-af12-2cf04dadc83d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:04.972821 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfd4c300-0c55-455c-af12-2cf04dadc83d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.973299 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfd4c300-0c55-455c-af12-2cf04dadc83d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.973748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfd4c300-0c55-455c-af12-2cf04dadc83d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:04.974431 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfd4c300-0c55-455c-af12-2cf04dadc83d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.974879 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfd4c300-0c55-455c-af12-2cf04dadc83d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.975294 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bfd4c300-0c55-455c-af12-2cf04dadc83d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:05.105002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-bfd4c300-0c55-455c-af12-2cf04dadc83d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:05.113178 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bfd4c300-0c55-455c-af12-2cf04dadc83d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.151438 Sep 08 13:55:05.113836 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 188/369] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:04 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:05.490418 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6054b7c1-38f4-4e8a-97a3-ebd7628d84ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:05.491062 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6054b7c1-38f4-4e8a-97a3-ebd7628d84ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:05.497876 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6054b7c1-38f4-4e8a-97a3-ebd7628d84ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:05.498368 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6054b7c1-38f4-4e8a-97a3-ebd7628d84ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:05.498802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6054b7c1-38f4-4e8a-97a3-ebd7628d84ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:05.499493 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6054b7c1-38f4-4e8a-97a3-ebd7628d84ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:05.499947 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6054b7c1-38f4-4e8a-97a3-ebd7628d84ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:05.500366 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6054b7c1-38f4-4e8a-97a3-ebd7628d84ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:05.634882 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6054b7c1-38f4-4e8a-97a3-ebd7628d84ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:05.643131 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6054b7c1-38f4-4e8a-97a3-ebd7628d84ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1501 microversion: 2.1 time: 0.156559 Sep 08 13:55:05.643695 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 189/370] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:05 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:05.664877 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f41710e-9554-4dff-b771-11fa9bd3919f"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:05.667265 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:05.672846 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:05.673322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:05.673773 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:05.674464 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:05.674917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:05.675338 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:05.698086 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] HTTP exception thrown: Cannot 'attach_volume' instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c while it is in vm_state rescued Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Request method failure captured: Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c/os-volume_attachments HTTP/1.1 Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 74 Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOqXoy_jlQIcZGQ-ASMeE8UfdjfJ-ZihXwARCECew2uUYEJfMfCz4Rpk1P8GXDhQweMznN18TYBN46-yUNN374-KOAFI0-TsMI8X4KAfqsDS34nfplWRAAQSTE1yMbeUr-5QSIeMgvOItm1HaVoYnDByAwRWoy1gn4Ja99jHM4ADiM Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 127bce2080d54fe4871b5aaa6cc394b5 Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:55:05.699682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_127bce2080d54fe4871b5aaa6cc394b5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 127bce2080d54fe4871b5aaa6cc394b5 Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-ServerRescueNegativeTestJSON-486286006-project Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 9f07158e4fd1430e839a1592e1e11b58 Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-486286006-project Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {"volumeAttachment": {"volumeId": "1f41710e-9554-4dff-b771-11fa9bd3919f"}} Sep 08 13:55:05.701763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Cannot 'attach_volume' instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c while it is in vm_state rescued Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'server_id': 'f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c', 'body': {'volumeAttachment': {'volumeId': '1f41710e-9554-4dff-b771-11fa9bd3919f'}}} Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:05.702625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c while it is in vm_state rescued Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:05.703799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:05.704924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:05.704924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:05.704924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c while it is in vm_state rescued Sep 08 13:55:05.704924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:55:05.704924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Returning 409 to user: Cannot 'attach_volume' instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c while it is in vm_state rescued {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:05.704924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-606e8aee-5513-4293-bbf5-63793f5e5876 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "POST /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040514 Sep 08 13:55:05.704924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 190/371] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 13:55:05 2022] POST /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 13:55:05.710119 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd3f2f3a-a5e0-4661-af9e-f3d53db6dfd2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:05.710643 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fd3f2f3a-a5e0-4661-af9e-f3d53db6dfd2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:05.716978 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd3f2f3a-a5e0-4661-af9e-f3d53db6dfd2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:05.717451 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd3f2f3a-a5e0-4661-af9e-f3d53db6dfd2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:05.717914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd3f2f3a-a5e0-4661-af9e-f3d53db6dfd2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:05.718593 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd3f2f3a-a5e0-4661-af9e-f3d53db6dfd2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:05.719046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd3f2f3a-a5e0-4661-af9e-f3d53db6dfd2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:05.719466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd3f2f3a-a5e0-4661-af9e-f3d53db6dfd2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:05.783319 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd3f2f3a-a5e0-4661-af9e-f3d53db6dfd2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "POST /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c/action" status: 202 len: 0 microversion: 2.1 time: 0.076405 Sep 08 13:55:05.783924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 191/372] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:55:05 2022] POST /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:55:05.788769 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c69f505d-dede-4597-9964-89035186b5c4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:05.789462 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c69f505d-dede-4597-9964-89035186b5c4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:05.795845 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c69f505d-dede-4597-9964-89035186b5c4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:05.796324 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c69f505d-dede-4597-9964-89035186b5c4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:05.796755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c69f505d-dede-4597-9964-89035186b5c4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:05.797438 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c69f505d-dede-4597-9964-89035186b5c4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:05.797917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c69f505d-dede-4597-9964-89035186b5c4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:05.798339 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c69f505d-dede-4597-9964-89035186b5c4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:05.930646 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c69f505d-dede-4597-9964-89035186b5c4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:05.938891 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c69f505d-dede-4597-9964-89035186b5c4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.153894 Sep 08 13:55:05.939455 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 192/373] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:05 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:05.943758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8e29dfd0-cfb5-4a11-8136-b95214745e2d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:05.944357 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8e29dfd0-cfb5-4a11-8136-b95214745e2d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:05.949891 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e29dfd0-cfb5-4a11-8136-b95214745e2d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:05.950808 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e29dfd0-cfb5-4a11-8136-b95214745e2d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:05.951239 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e29dfd0-cfb5-4a11-8136-b95214745e2d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:05.951921 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e29dfd0-cfb5-4a11-8136-b95214745e2d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:05.952372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e29dfd0-cfb5-4a11-8136-b95214745e2d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:05.952790 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8e29dfd0-cfb5-4a11-8136-b95214745e2d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:06.083864 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8e29dfd0-cfb5-4a11-8136-b95214745e2d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:06.092307 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8e29dfd0-cfb5-4a11-8136-b95214745e2d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1509 microversion: 2.1 time: 0.151913 Sep 08 13:55:06.092870 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 193/374] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:05 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:06.134339 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5807d142-c40c-4634-8bb9-88366a8da0ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:06.134939 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5807d142-c40c-4634-8bb9-88366a8da0ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:06.141022 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5807d142-c40c-4634-8bb9-88366a8da0ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:06.141500 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5807d142-c40c-4634-8bb9-88366a8da0ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:06.141956 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5807d142-c40c-4634-8bb9-88366a8da0ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:06.142636 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5807d142-c40c-4634-8bb9-88366a8da0ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:06.143078 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5807d142-c40c-4634-8bb9-88366a8da0ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:06.143491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5807d142-c40c-4634-8bb9-88366a8da0ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:06.271312 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5807d142-c40c-4634-8bb9-88366a8da0ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:06.278855 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5807d142-c40c-4634-8bb9-88366a8da0ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.148100 Sep 08 13:55:06.279411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 194/375] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:06 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:06.691547 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-099cd475-86c5-4134-9a56-5a9e8f2a1f95 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "POST /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.407343 Sep 08 13:55:06.692549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 182/376] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 13:55:04 2022] POST /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef/os-volume_attachments => generated 194 bytes in 2409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:55:06.962914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23c7061e-78f2-461e-b26a-f1058558d4f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:06.963645 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-23c7061e-78f2-461e-b26a-f1058558d4f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:06.971187 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23c7061e-78f2-461e-b26a-f1058558d4f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:06.971938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23c7061e-78f2-461e-b26a-f1058558d4f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:06.972286 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23c7061e-78f2-461e-b26a-f1058558d4f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:06.973060 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23c7061e-78f2-461e-b26a-f1058558d4f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:06.973585 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23c7061e-78f2-461e-b26a-f1058558d4f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:06.974099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23c7061e-78f2-461e-b26a-f1058558d4f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:07.115606 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f7bb9680-0ed5-4dfb-bb90-1baa7b67edc5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:07.116307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f7bb9680-0ed5-4dfb-bb90-1baa7b67edc5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:07.122684 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7bb9680-0ed5-4dfb-bb90-1baa7b67edc5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:07.123167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7bb9680-0ed5-4dfb-bb90-1baa7b67edc5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:07.123603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7bb9680-0ed5-4dfb-bb90-1baa7b67edc5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:07.124297 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7bb9680-0ed5-4dfb-bb90-1baa7b67edc5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:07.124750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7bb9680-0ed5-4dfb-bb90-1baa7b67edc5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:07.125173 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7bb9680-0ed5-4dfb-bb90-1baa7b67edc5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:07.186011 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-23c7061e-78f2-461e-b26a-f1058558d4f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:07.194982 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23c7061e-78f2-461e-b26a-f1058558d4f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.236350 Sep 08 13:55:07.195648 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 195/377] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:06 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:07.300471 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f7bb9680-0ed5-4dfb-bb90-1baa7b67edc5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:07.301045 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7d5a36a0-730a-40ab-ab16-b3792c5b8dba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:07.301448 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7d5a36a0-730a-40ab-ab16-b3792c5b8dba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:07.307422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d5a36a0-730a-40ab-ab16-b3792c5b8dba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:07.307911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d5a36a0-730a-40ab-ab16-b3792c5b8dba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:07.308340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d5a36a0-730a-40ab-ab16-b3792c5b8dba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:07.308786 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f7bb9680-0ed5-4dfb-bb90-1baa7b67edc5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1509 microversion: 2.1 time: 0.197829 Sep 08 13:55:07.309035 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d5a36a0-730a-40ab-ab16-b3792c5b8dba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:07.309908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d5a36a0-730a-40ab-ab16-b3792c5b8dba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:07.310069 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 183/378] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:07 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:07.310171 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7d5a36a0-730a-40ab-ab16-b3792c5b8dba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:07.438799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7d5a36a0-730a-40ab-ab16-b3792c5b8dba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:07.446472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7d5a36a0-730a-40ab-ab16-b3792c5b8dba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.149445 Sep 08 13:55:07.447309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 196/379] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:07 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:08.218734 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6cc84f2-0526-4754-9c68-b055f7d4180a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:08.219275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6cc84f2-0526-4754-9c68-b055f7d4180a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:08.226181 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6cc84f2-0526-4754-9c68-b055f7d4180a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:08.226656 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6cc84f2-0526-4754-9c68-b055f7d4180a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:08.227080 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6cc84f2-0526-4754-9c68-b055f7d4180a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:08.227756 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6cc84f2-0526-4754-9c68-b055f7d4180a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:08.228199 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6cc84f2-0526-4754-9c68-b055f7d4180a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:08.228611 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6cc84f2-0526-4754-9c68-b055f7d4180a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:08.332334 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b394ab77-536f-4aac-9dec-0624da7f8cc7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:08.333040 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b394ab77-536f-4aac-9dec-0624da7f8cc7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:08.340285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b394ab77-536f-4aac-9dec-0624da7f8cc7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:08.341352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b394ab77-536f-4aac-9dec-0624da7f8cc7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:08.341811 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b394ab77-536f-4aac-9dec-0624da7f8cc7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:08.342510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b394ab77-536f-4aac-9dec-0624da7f8cc7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:08.342967 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b394ab77-536f-4aac-9dec-0624da7f8cc7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:08.343392 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b394ab77-536f-4aac-9dec-0624da7f8cc7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:08.365409 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c6cc84f2-0526-4754-9c68-b055f7d4180a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:08.373602 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6cc84f2-0526-4754-9c68-b055f7d4180a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.159307 Sep 08 13:55:08.374206 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 184/380] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:08 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:08.470555 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08c395c7-4740-4903-afbc-a5cd3dedb5b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:08.471223 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08c395c7-4740-4903-afbc-a5cd3dedb5b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:08.478278 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08c395c7-4740-4903-afbc-a5cd3dedb5b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:08.478766 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08c395c7-4740-4903-afbc-a5cd3dedb5b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:08.479209 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08c395c7-4740-4903-afbc-a5cd3dedb5b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:08.480201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08c395c7-4740-4903-afbc-a5cd3dedb5b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:08.480695 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08c395c7-4740-4903-afbc-a5cd3dedb5b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:08.481474 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08c395c7-4740-4903-afbc-a5cd3dedb5b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:08.484774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b394ab77-536f-4aac-9dec-0624da7f8cc7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:08.492770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b394ab77-536f-4aac-9dec-0624da7f8cc7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1509 microversion: 2.1 time: 0.164280 Sep 08 13:55:08.493437 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 197/381] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:08 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:08.614117 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-08c395c7-4740-4903-afbc-a5cd3dedb5b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:08.623565 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08c395c7-4740-4903-afbc-a5cd3dedb5b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.157467 Sep 08 13:55:08.624439 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 185/382] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:08 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:09.396460 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e02f9ac-c1f6-4f81-afdb-c2587636b816 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.397078 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e02f9ac-c1f6-4f81-afdb-c2587636b816 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:09.403716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e02f9ac-c1f6-4f81-afdb-c2587636b816 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.404195 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e02f9ac-c1f6-4f81-afdb-c2587636b816 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.404631 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e02f9ac-c1f6-4f81-afdb-c2587636b816 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.404983 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-49954098-1518-4ca3-874c-b70ecf27c70b req-0c3598a0-5232-40a4-b18b-1043b408cc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959f81c9-4c88-41e0-8eb9-e5b3fb5faa32", "name": "network-vif-plugged", "status": "completed", "tag": "c56674e2-ad46-43bc-9f41-cf0a4987597f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:09.405440 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e02f9ac-c1f6-4f81-afdb-c2587636b816 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.405778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e02f9ac-c1f6-4f81-afdb-c2587636b816 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.406202 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e02f9ac-c1f6-4f81-afdb-c2587636b816 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.415304 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-49954098-1518-4ca3-874c-b70ecf27c70b req-0c3598a0-5232-40a4-b18b-1043b408cc4f service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.415857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-49954098-1518-4ca3-874c-b70ecf27c70b req-0c3598a0-5232-40a4-b18b-1043b408cc4f service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.416355 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-49954098-1518-4ca3-874c-b70ecf27c70b req-0c3598a0-5232-40a4-b18b-1043b408cc4f service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.428907 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-49954098-1518-4ca3-874c-b70ecf27c70b req-0c3598a0-5232-40a4-b18b-1043b408cc4f service nova] Creating event network-vif-plugged:c56674e2-ad46-43bc-9f41-cf0a4987597f for instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 on hv-cinder-82002 Sep 08 13:55:09.433816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-49954098-1518-4ca3-874c-b70ecf27c70b req-0c3598a0-5232-40a4-b18b-1043b408cc4f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032849 Sep 08 13:55:09.434889 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 186/383] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:55:09.525524 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a4939109-3d51-42c7-b8b1-03b3d430132b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.526248 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a4939109-3d51-42c7-b8b1-03b3d430132b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:09.532470 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4939109-3d51-42c7-b8b1-03b3d430132b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.532952 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4939109-3d51-42c7-b8b1-03b3d430132b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.533386 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4939109-3d51-42c7-b8b1-03b3d430132b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.534163 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4939109-3d51-42c7-b8b1-03b3d430132b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.534622 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4939109-3d51-42c7-b8b1-03b3d430132b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.535043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4939109-3d51-42c7-b8b1-03b3d430132b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.538780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e02f9ac-c1f6-4f81-afdb-c2587636b816 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:09.546903 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e02f9ac-c1f6-4f81-afdb-c2587636b816 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.154295 Sep 08 13:55:09.547470 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 198/384] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:09 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:09.646413 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-59636364-52d6-43a5-b1a7-72924d0a386e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.647206 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-59636364-52d6-43a5-b1a7-72924d0a386e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:09.653266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59636364-52d6-43a5-b1a7-72924d0a386e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.653773 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59636364-52d6-43a5-b1a7-72924d0a386e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.654211 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59636364-52d6-43a5-b1a7-72924d0a386e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.654902 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59636364-52d6-43a5-b1a7-72924d0a386e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.655355 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59636364-52d6-43a5-b1a7-72924d0a386e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.655772 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-59636364-52d6-43a5-b1a7-72924d0a386e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.667847 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a4939109-3d51-42c7-b8b1-03b3d430132b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:09.676045 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a4939109-3d51-42c7-b8b1-03b3d430132b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1509 microversion: 2.1 time: 0.163128 Sep 08 13:55:09.676699 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 187/385] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:09 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:09.785149 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-59636364-52d6-43a5-b1a7-72924d0a386e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:09.788652 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:09.793572 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-59636364-52d6-43a5-b1a7-72924d0a386e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.151040 Sep 08 13:55:09.794671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 199/386] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:09 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:10.570806 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-390a4bb1-bb6b-4b73-a654-5ff420752f30 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:10.571423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-390a4bb1-bb6b-4b73-a654-5ff420752f30 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:10.577788 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390a4bb1-bb6b-4b73-a654-5ff420752f30 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:10.578267 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390a4bb1-bb6b-4b73-a654-5ff420752f30 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:10.578696 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390a4bb1-bb6b-4b73-a654-5ff420752f30 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:10.579409 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390a4bb1-bb6b-4b73-a654-5ff420752f30 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:10.579854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390a4bb1-bb6b-4b73-a654-5ff420752f30 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:10.580357 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-390a4bb1-bb6b-4b73-a654-5ff420752f30 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:10.699576 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33c18387-95bc-45de-9883-96e479ee109f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:10.700335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33c18387-95bc-45de-9883-96e479ee109f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:10.707573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c18387-95bc-45de-9883-96e479ee109f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:10.708057 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c18387-95bc-45de-9883-96e479ee109f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:10.708496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c18387-95bc-45de-9883-96e479ee109f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:10.709192 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c18387-95bc-45de-9883-96e479ee109f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:10.709642 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c18387-95bc-45de-9883-96e479ee109f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:10.710461 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33c18387-95bc-45de-9883-96e479ee109f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:10.720964 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-390a4bb1-bb6b-4b73-a654-5ff420752f30 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:10.729153 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-390a4bb1-bb6b-4b73-a654-5ff420752f30 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.162210 Sep 08 13:55:10.741933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 188/387] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:10 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:10.816329 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d6f5fbdc-459a-4313-9f4a-ab0409242305 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:10.817085 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d6f5fbdc-459a-4313-9f4a-ab0409242305 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:10.823066 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6f5fbdc-459a-4313-9f4a-ab0409242305 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:10.824354 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6f5fbdc-459a-4313-9f4a-ab0409242305 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:10.824789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6f5fbdc-459a-4313-9f4a-ab0409242305 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:10.825474 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6f5fbdc-459a-4313-9f4a-ab0409242305 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:10.825940 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6f5fbdc-459a-4313-9f4a-ab0409242305 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:10.826356 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d6f5fbdc-459a-4313-9f4a-ab0409242305 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:10.848002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-33c18387-95bc-45de-9883-96e479ee109f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:10.855786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33c18387-95bc-45de-9883-96e479ee109f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1509 microversion: 2.1 time: 0.160695 Sep 08 13:55:10.869758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 200/388] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:10 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:10.965868 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d6f5fbdc-459a-4313-9f4a-ab0409242305 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:10.974278 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d6f5fbdc-459a-4313-9f4a-ab0409242305 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.161601 Sep 08 13:55:10.975108 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 189/389] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:10 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:11.753510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-09085d35-7073-4cac-a642-19b06b02c683 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:11.754144 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-09085d35-7073-4cac-a642-19b06b02c683 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:11.760534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09085d35-7073-4cac-a642-19b06b02c683 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:11.761020 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09085d35-7073-4cac-a642-19b06b02c683 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:11.761453 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09085d35-7073-4cac-a642-19b06b02c683 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:11.762176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09085d35-7073-4cac-a642-19b06b02c683 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:11.763298 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09085d35-7073-4cac-a642-19b06b02c683 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:11.763727 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09085d35-7073-4cac-a642-19b06b02c683 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:11.879431 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4223202b-b3cf-457a-8f40-d9a9010022eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:11.880035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4223202b-b3cf-457a-8f40-d9a9010022eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:11.886325 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4223202b-b3cf-457a-8f40-d9a9010022eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:11.886802 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4223202b-b3cf-457a-8f40-d9a9010022eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:11.887258 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4223202b-b3cf-457a-8f40-d9a9010022eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:11.887940 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4223202b-b3cf-457a-8f40-d9a9010022eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:11.888382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4223202b-b3cf-457a-8f40-d9a9010022eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:11.888796 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4223202b-b3cf-457a-8f40-d9a9010022eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:11.893769 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-09085d35-7073-4cac-a642-19b06b02c683 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:11.902647 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-09085d35-7073-4cac-a642-19b06b02c683 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.152867 Sep 08 13:55:11.903411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 201/390] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:11 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:11.998847 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-79297a6a-afcb-4f19-965c-17e9eb43aedc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:11.999774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-79297a6a-afcb-4f19-965c-17e9eb43aedc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:12.007148 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79297a6a-afcb-4f19-965c-17e9eb43aedc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:12.007739 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79297a6a-afcb-4f19-965c-17e9eb43aedc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:12.008265 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79297a6a-afcb-4f19-965c-17e9eb43aedc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:12.009313 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79297a6a-afcb-4f19-965c-17e9eb43aedc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:12.010128 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79297a6a-afcb-4f19-965c-17e9eb43aedc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:12.010888 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79297a6a-afcb-4f19-965c-17e9eb43aedc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:12.019863 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4223202b-b3cf-457a-8f40-d9a9010022eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:12.028285 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4223202b-b3cf-457a-8f40-d9a9010022eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1515 microversion: 2.1 time: 0.152556 Sep 08 13:55:12.028864 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 190/391] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:11 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:12.208270 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-79297a6a-afcb-4f19-965c-17e9eb43aedc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:12.217905 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-79297a6a-afcb-4f19-965c-17e9eb43aedc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.223930 Sep 08 13:55:12.218482 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 202/392] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:11 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:12.926372 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-291d2062-3c9b-4ef0-9b24-e5d51b192bc0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:12.926984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-291d2062-3c9b-4ef0-9b24-e5d51b192bc0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:12.933387 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291d2062-3c9b-4ef0-9b24-e5d51b192bc0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:12.933911 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291d2062-3c9b-4ef0-9b24-e5d51b192bc0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:12.934387 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291d2062-3c9b-4ef0-9b24-e5d51b192bc0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:12.935570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291d2062-3c9b-4ef0-9b24-e5d51b192bc0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:12.936021 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291d2062-3c9b-4ef0-9b24-e5d51b192bc0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:12.936444 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-291d2062-3c9b-4ef0-9b24-e5d51b192bc0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:13.065072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-291d2062-3c9b-4ef0-9b24-e5d51b192bc0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:13.073288 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-291d2062-3c9b-4ef0-9b24-e5d51b192bc0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.150891 Sep 08 13:55:13.073876 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 191/393] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:12 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:13.240056 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c85d0ad3-3876-4a5e-8345-49c6b221f4c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:13.240598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c85d0ad3-3876-4a5e-8345-49c6b221f4c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:13.247077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c85d0ad3-3876-4a5e-8345-49c6b221f4c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:13.247556 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c85d0ad3-3876-4a5e-8345-49c6b221f4c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:13.247990 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c85d0ad3-3876-4a5e-8345-49c6b221f4c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:13.248676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c85d0ad3-3876-4a5e-8345-49c6b221f4c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:13.249123 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c85d0ad3-3876-4a5e-8345-49c6b221f4c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:13.249540 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c85d0ad3-3876-4a5e-8345-49c6b221f4c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:13.422347 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d28e6d6-9469-4fea-b22c-827be6cb7a20 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Action: 'create', calling method: .version_select at 0x7f5be45a3700>, body: {"keypair": {"name": "tempest-keypair-60288270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTxjJIVUoMjQOX7ei7yY+gAIE3cimDvXXA2l7JogRq2qLSpvDS4Qnp9OXyTdbapydQmLUNrBJOq4lWOi+g2t4v3baoxInzozQRL1JxVarEwQdgSMZVLZwFAWXdKGYyX7w=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:13.439464 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-0d28e6d6-9469-4fea-b22c-827be6cb7a20 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Getting quotas for project 127bce2080d54fe4871b5aaa6cc394b5. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:55:13.443680 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-0d28e6d6-9469-4fea-b22c-827be6cb7a20 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Getting quotas for user 9f07158e4fd1430e839a1592e1e11b58 and project 127bce2080d54fe4871b5aaa6cc394b5. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:55:13.468219 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d28e6d6-9469-4fea-b22c-827be6cb7a20 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.049747 Sep 08 13:55:13.475233 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 192/394] 10.222.0.55 () {60 vars in 1159 bytes} [Thu Sep 8 13:55:13 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:55:13.610765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c85d0ad3-3876-4a5e-8345-49c6b221f4c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:13.618664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c85d0ad3-3876-4a5e-8345-49c6b221f4c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1367 microversion: 2.1 time: 0.382422 Sep 08 13:55:13.619219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 203/395] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:13 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:14.099919 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c21de63-08e1-440e-99e3-e0c6eb9495c0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:14.100790 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c21de63-08e1-440e-99e3-e0c6eb9495c0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:14.110347 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c21de63-08e1-440e-99e3-e0c6eb9495c0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:14.110869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c21de63-08e1-440e-99e3-e0c6eb9495c0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:14.111300 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c21de63-08e1-440e-99e3-e0c6eb9495c0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:14.112006 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c21de63-08e1-440e-99e3-e0c6eb9495c0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:14.112451 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c21de63-08e1-440e-99e3-e0c6eb9495c0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:14.112868 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c21de63-08e1-440e-99e3-e0c6eb9495c0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:14.246055 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c21de63-08e1-440e-99e3-e0c6eb9495c0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:14.254589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c21de63-08e1-440e-99e3-e0c6eb9495c0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.158747 Sep 08 13:55:14.255185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 193/396] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:14 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:14.641651 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-abea1a8e-063a-46fd-99b8-83c8c16a5e21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:14.642223 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-abea1a8e-063a-46fd-99b8-83c8c16a5e21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:14.649119 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abea1a8e-063a-46fd-99b8-83c8c16a5e21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:14.649602 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abea1a8e-063a-46fd-99b8-83c8c16a5e21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:14.650068 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abea1a8e-063a-46fd-99b8-83c8c16a5e21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:14.650776 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abea1a8e-063a-46fd-99b8-83c8c16a5e21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:14.651277 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abea1a8e-063a-46fd-99b8-83c8c16a5e21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:14.651708 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-abea1a8e-063a-46fd-99b8-83c8c16a5e21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:14.761025 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2050560647", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6ea2a7a-ef84-454a-b305-c470482cf7fa"}], "security_groups": [{"name": "tempest-securitygroup--1755708901"}], "key_name": "tempest-keypair-60288270", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:14.785629 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-abea1a8e-063a-46fd-99b8-83c8c16a5e21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:14.793587 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-abea1a8e-063a-46fd-99b8-83c8c16a5e21 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1558 microversion: 2.1 time: 0.156400 Sep 08 13:55:14.794268 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 204/397] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:14 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:14.816319 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-befa9192-9f32-445a-be7e-393377ef4d45 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:14.816816 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-befa9192-9f32-445a-be7e-393377ef4d45 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:14.822676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-befa9192-9f32-445a-be7e-393377ef4d45 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:14.823212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-befa9192-9f32-445a-be7e-393377ef4d45 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:14.823650 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-befa9192-9f32-445a-be7e-393377ef4d45 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:14.824338 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-befa9192-9f32-445a-be7e-393377ef4d45 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:14.824805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-befa9192-9f32-445a-be7e-393377ef4d45 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:14.825888 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-befa9192-9f32-445a-be7e-393377ef4d45 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:14.877485 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] validate_networks() for [('a6ea2a7a-ef84-454a-b305-c470482cf7fa', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:55:14.958711 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-befa9192-9f32-445a-be7e-393377ef4d45 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146388 Sep 08 13:55:14.959410 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 205/398] 10.222.0.55 () {58 vars in 1275 bytes} [Thu Sep 8 13:55:14 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:55:15.280012 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7166aef4-ec5a-4b91-a2c9-9dadd0f14bf8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:15.280628 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7166aef4-ec5a-4b91-a2c9-9dadd0f14bf8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:15.280904 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:55:15.281337 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:55:15.281809 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:55:15.282364 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:55:15.282692 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:55:15.295386 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:15.295866 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:15.296299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:15.297028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:15.297131 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7166aef4-ec5a-4b91-a2c9-9dadd0f14bf8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:15.297483 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:15.297616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7166aef4-ec5a-4b91-a2c9-9dadd0f14bf8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:15.297936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:15.298103 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7166aef4-ec5a-4b91-a2c9-9dadd0f14bf8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:15.298791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7166aef4-ec5a-4b91-a2c9-9dadd0f14bf8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:15.299238 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7166aef4-ec5a-4b91-a2c9-9dadd0f14bf8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:15.299650 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7166aef4-ec5a-4b91-a2c9-9dadd0f14bf8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:15.315251 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Getting quotas for project 127bce2080d54fe4871b5aaa6cc394b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:55:15.319663 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Getting quotas for user 9f07158e4fd1430e839a1592e1e11b58 and project 127bce2080d54fe4871b5aaa6cc394b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:55:15.331027 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:55:15.333355 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:55:15.389681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e33f8bde-c3bf-41bb-aa08-2e249c9bf9a4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.633203 Sep 08 13:55:15.390739 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 194/399] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:55:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:55:15.402233 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cdace8b3-f3f1-4562-927a-5b41b68b688f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:15.402944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cdace8b3-f3f1-4562-927a-5b41b68b688f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:15.475579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cdace8b3-f3f1-4562-927a-5b41b68b688f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:15.483482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cdace8b3-f3f1-4562-927a-5b41b68b688f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1244 microversion: 2.1 time: 0.085060 Sep 08 13:55:15.484224 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 195/400] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:15 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:15.508755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7166aef4-ec5a-4b91-a2c9-9dadd0f14bf8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:15.519625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7166aef4-ec5a-4b91-a2c9-9dadd0f14bf8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.245148 Sep 08 13:55:15.520394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 206/401] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:15 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:15.971398 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-034d367c-5900-4256-8712-23b54ddbf305 req-1bc30521-6535-4772-a50a-eccfc2551d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959f81c9-4c88-41e0-8eb9-e5b3fb5faa32", "tag": "c56674e2-ad46-43bc-9f41-cf0a4987597f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:15.980910 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-034d367c-5900-4256-8712-23b54ddbf305 req-1bc30521-6535-4772-a50a-eccfc2551d27 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:15.982078 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-034d367c-5900-4256-8712-23b54ddbf305 req-1bc30521-6535-4772-a50a-eccfc2551d27 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:15.982509 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-034d367c-5900-4256-8712-23b54ddbf305 req-1bc30521-6535-4772-a50a-eccfc2551d27 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:15.994195 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-034d367c-5900-4256-8712-23b54ddbf305 req-1bc30521-6535-4772-a50a-eccfc2551d27 service nova] Creating event network-changed:c56674e2-ad46-43bc-9f41-cf0a4987597f for instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 on hv-cinder-82002 Sep 08 13:55:15.999186 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-034d367c-5900-4256-8712-23b54ddbf305 req-1bc30521-6535-4772-a50a-eccfc2551d27 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031511 Sep 08 13:55:15.999791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 196/402] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:55:16.508732 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c9242ff3-c8d2-49bb-b996-6eb3d5bdc5bf tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:16.509330 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c9242ff3-c8d2-49bb-b996-6eb3d5bdc5bf tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:16.517615 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9242ff3-c8d2-49bb-b996-6eb3d5bdc5bf tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:16.518394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9242ff3-c8d2-49bb-b996-6eb3d5bdc5bf tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:16.518899 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9242ff3-c8d2-49bb-b996-6eb3d5bdc5bf tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:16.519723 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9242ff3-c8d2-49bb-b996-6eb3d5bdc5bf tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:16.520265 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9242ff3-c8d2-49bb-b996-6eb3d5bdc5bf tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:16.520804 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9242ff3-c8d2-49bb-b996-6eb3d5bdc5bf tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:16.543930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c9fff00d-7caf-4830-8ba6-7d873f16a6e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:16.544984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c9fff00d-7caf-4830-8ba6-7d873f16a6e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:16.551763 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9fff00d-7caf-4830-8ba6-7d873f16a6e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:16.552256 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9fff00d-7caf-4830-8ba6-7d873f16a6e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:16.552694 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9fff00d-7caf-4830-8ba6-7d873f16a6e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:16.553395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9fff00d-7caf-4830-8ba6-7d873f16a6e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:16.553990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9fff00d-7caf-4830-8ba6-7d873f16a6e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:16.554684 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9fff00d-7caf-4830-8ba6-7d873f16a6e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:16.592518 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c9242ff3-c8d2-49bb-b996-6eb3d5bdc5bf tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:16.603229 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c9242ff3-c8d2-49bb-b996-6eb3d5bdc5bf tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1248 microversion: 2.1 time: 0.098529 Sep 08 13:55:16.603813 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 207/403] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:16 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1248 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:16.687466 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c9fff00d-7caf-4830-8ba6-7d873f16a6e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:16.696022 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c9fff00d-7caf-4830-8ba6-7d873f16a6e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.156841 Sep 08 13:55:16.696586 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 197/404] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:16 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:17.626181 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-203238a2-8196-4b30-9278-7c90738b258b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:17.626789 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-203238a2-8196-4b30-9278-7c90738b258b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:17.633147 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-203238a2-8196-4b30-9278-7c90738b258b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:17.633627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-203238a2-8196-4b30-9278-7c90738b258b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:17.634094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-203238a2-8196-4b30-9278-7c90738b258b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:17.634829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-203238a2-8196-4b30-9278-7c90738b258b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:17.635276 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-203238a2-8196-4b30-9278-7c90738b258b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:17.635694 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-203238a2-8196-4b30-9278-7c90738b258b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:17.705072 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-203238a2-8196-4b30-9278-7c90738b258b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:17.713551 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-203238a2-8196-4b30-9278-7c90738b258b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1296 microversion: 2.1 time: 0.091217 Sep 08 13:55:17.714440 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 208/405] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:17 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:17.720610 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2f5b706b-9dda-4801-adc9-296498deb99e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:17.721879 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2f5b706b-9dda-4801-adc9-296498deb99e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:17.732020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f5b706b-9dda-4801-adc9-296498deb99e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:17.732580 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f5b706b-9dda-4801-adc9-296498deb99e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:17.733015 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f5b706b-9dda-4801-adc9-296498deb99e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:17.733786 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f5b706b-9dda-4801-adc9-296498deb99e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:17.734223 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f5b706b-9dda-4801-adc9-296498deb99e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:17.734639 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2f5b706b-9dda-4801-adc9-296498deb99e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:17.896710 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2f5b706b-9dda-4801-adc9-296498deb99e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:17.911195 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2f5b706b-9dda-4801-adc9-296498deb99e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.194717 Sep 08 13:55:17.912001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 198/406] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:17 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:18.738632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ec6f9b91-def7-405b-9831-b33770dfe8ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:18.739171 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ec6f9b91-def7-405b-9831-b33770dfe8ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:18.745492 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec6f9b91-def7-405b-9831-b33770dfe8ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:18.745999 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec6f9b91-def7-405b-9831-b33770dfe8ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:18.746427 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec6f9b91-def7-405b-9831-b33770dfe8ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:18.747689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec6f9b91-def7-405b-9831-b33770dfe8ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:18.748130 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec6f9b91-def7-405b-9831-b33770dfe8ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:18.748541 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec6f9b91-def7-405b-9831-b33770dfe8ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:18.820472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ec6f9b91-def7-405b-9831-b33770dfe8ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:18.830620 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ec6f9b91-def7-405b-9831-b33770dfe8ad tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1296 microversion: 2.1 time: 0.095858 Sep 08 13:55:18.838529 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 209/407] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:18 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:18.935387 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-91cfb6ac-6297-4d5e-a559-e7dac3de698f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:18.935950 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-91cfb6ac-6297-4d5e-a559-e7dac3de698f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:18.942408 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91cfb6ac-6297-4d5e-a559-e7dac3de698f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:18.942885 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91cfb6ac-6297-4d5e-a559-e7dac3de698f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:18.943319 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91cfb6ac-6297-4d5e-a559-e7dac3de698f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:18.944011 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91cfb6ac-6297-4d5e-a559-e7dac3de698f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:18.944457 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91cfb6ac-6297-4d5e-a559-e7dac3de698f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:18.949971 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-91cfb6ac-6297-4d5e-a559-e7dac3de698f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:19.174798 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-91cfb6ac-6297-4d5e-a559-e7dac3de698f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:19.182837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-91cfb6ac-6297-4d5e-a559-e7dac3de698f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.251981 Sep 08 13:55:19.183592 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 199/408] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:18 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:19.853296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-28e49fcb-9f06-4b65-a72b-3116104b063d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:19.853904 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-28e49fcb-9f06-4b65-a72b-3116104b063d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:19.860797 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e49fcb-9f06-4b65-a72b-3116104b063d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:19.861275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e49fcb-9f06-4b65-a72b-3116104b063d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:19.861703 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e49fcb-9f06-4b65-a72b-3116104b063d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:19.862421 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e49fcb-9f06-4b65-a72b-3116104b063d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:19.862869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e49fcb-9f06-4b65-a72b-3116104b063d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:19.863290 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-28e49fcb-9f06-4b65-a72b-3116104b063d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:19.927462 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-28e49fcb-9f06-4b65-a72b-3116104b063d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:19.935027 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-28e49fcb-9f06-4b65-a72b-3116104b063d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1302 microversion: 2.1 time: 0.085673 Sep 08 13:55:19.935582 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 210/409] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:19 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:20.206665 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3485725-de6d-4b68-8ff3-9a160807ec91 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:20.207287 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3485725-de6d-4b68-8ff3-9a160807ec91 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:20.213978 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3485725-de6d-4b68-8ff3-9a160807ec91 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:20.214461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3485725-de6d-4b68-8ff3-9a160807ec91 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:20.214899 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3485725-de6d-4b68-8ff3-9a160807ec91 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:20.216164 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3485725-de6d-4b68-8ff3-9a160807ec91 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:20.216620 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3485725-de6d-4b68-8ff3-9a160807ec91 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:20.217076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3485725-de6d-4b68-8ff3-9a160807ec91 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:20.342274 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3485725-de6d-4b68-8ff3-9a160807ec91 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:20.350393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3485725-de6d-4b68-8ff3-9a160807ec91 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.147597 Sep 08 13:55:20.350954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 200/410] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:20 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:20.958048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0cff4366-8806-4fd0-9909-7ab0c70ca492 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:20.958650 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0cff4366-8806-4fd0-9909-7ab0c70ca492 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:20.965283 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff4366-8806-4fd0-9909-7ab0c70ca492 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:20.965790 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff4366-8806-4fd0-9909-7ab0c70ca492 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:20.966215 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff4366-8806-4fd0-9909-7ab0c70ca492 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:20.966888 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff4366-8806-4fd0-9909-7ab0c70ca492 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:20.967331 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff4366-8806-4fd0-9909-7ab0c70ca492 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:20.967740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0cff4366-8806-4fd0-9909-7ab0c70ca492 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:21.028524 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0cff4366-8806-4fd0-9909-7ab0c70ca492 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:21.036090 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0cff4366-8806-4fd0-9909-7ab0c70ca492 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1302 microversion: 2.1 time: 0.081885 Sep 08 13:55:21.036667 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 211/411] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:20 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1302 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:21.373390 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-68a3d586-f25b-4385-bc51-4040efc2d020 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:21.374058 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-68a3d586-f25b-4385-bc51-4040efc2d020 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:21.380486 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68a3d586-f25b-4385-bc51-4040efc2d020 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:21.380970 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68a3d586-f25b-4385-bc51-4040efc2d020 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:21.381406 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68a3d586-f25b-4385-bc51-4040efc2d020 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:21.382130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68a3d586-f25b-4385-bc51-4040efc2d020 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:21.382581 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68a3d586-f25b-4385-bc51-4040efc2d020 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:21.383005 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-68a3d586-f25b-4385-bc51-4040efc2d020 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:21.401709 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:21.514083 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-68a3d586-f25b-4385-bc51-4040efc2d020 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:21.523160 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-68a3d586-f25b-4385-bc51-4040efc2d020 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.153619 Sep 08 13:55:21.523720 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 201/412] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:21 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:22.058964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7232ce96-1347-4b40-a2db-6bf8af4b1ec6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:22.059487 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7232ce96-1347-4b40-a2db-6bf8af4b1ec6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:22.065977 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7232ce96-1347-4b40-a2db-6bf8af4b1ec6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:22.066448 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7232ce96-1347-4b40-a2db-6bf8af4b1ec6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:22.066873 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7232ce96-1347-4b40-a2db-6bf8af4b1ec6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:22.067545 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7232ce96-1347-4b40-a2db-6bf8af4b1ec6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:22.067988 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7232ce96-1347-4b40-a2db-6bf8af4b1ec6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:22.068400 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7232ce96-1347-4b40-a2db-6bf8af4b1ec6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:22.131666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7232ce96-1347-4b40-a2db-6bf8af4b1ec6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:22.139271 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7232ce96-1347-4b40-a2db-6bf8af4b1ec6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1302 microversion: 2.1 time: 0.084309 Sep 08 13:55:22.139852 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 212/413] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:22 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:22.546831 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ba6979f3-161f-416c-b539-e329c46db3ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:22.547437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ba6979f3-161f-416c-b539-e329c46db3ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:22.553934 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6979f3-161f-416c-b539-e329c46db3ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:22.554416 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6979f3-161f-416c-b539-e329c46db3ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:22.554853 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6979f3-161f-416c-b539-e329c46db3ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:22.555794 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6979f3-161f-416c-b539-e329c46db3ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:22.556252 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6979f3-161f-416c-b539-e329c46db3ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:22.556675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba6979f3-161f-416c-b539-e329c46db3ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:22.681669 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ba6979f3-161f-416c-b539-e329c46db3ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:22.690317 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ba6979f3-161f-416c-b539-e329c46db3ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.147388 Sep 08 13:55:22.690884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 202/414] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:22 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:23.161795 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-91312877-c35c-40fd-990d-5f9671bef8fe tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:23.162403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-91312877-c35c-40fd-990d-5f9671bef8fe tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:23.168846 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91312877-c35c-40fd-990d-5f9671bef8fe tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:23.169327 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91312877-c35c-40fd-990d-5f9671bef8fe tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:23.170271 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91312877-c35c-40fd-990d-5f9671bef8fe tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:23.170958 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91312877-c35c-40fd-990d-5f9671bef8fe tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:23.171406 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91312877-c35c-40fd-990d-5f9671bef8fe tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:23.171821 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-91312877-c35c-40fd-990d-5f9671bef8fe tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:23.242267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-91312877-c35c-40fd-990d-5f9671bef8fe tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:23.250241 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-91312877-c35c-40fd-990d-5f9671bef8fe tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1302 microversion: 2.1 time: 0.092240 Sep 08 13:55:23.261756 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 213/415] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:23 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:23.714439 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ff66ca5-f24b-4c8d-b1ce-5f65e07211dc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:23.714987 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ff66ca5-f24b-4c8d-b1ce-5f65e07211dc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:23.721560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ff66ca5-f24b-4c8d-b1ce-5f65e07211dc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:23.722077 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ff66ca5-f24b-4c8d-b1ce-5f65e07211dc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:23.722515 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ff66ca5-f24b-4c8d-b1ce-5f65e07211dc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:23.723224 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ff66ca5-f24b-4c8d-b1ce-5f65e07211dc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:23.723674 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ff66ca5-f24b-4c8d-b1ce-5f65e07211dc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:23.724100 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ff66ca5-f24b-4c8d-b1ce-5f65e07211dc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:23.943083 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ff66ca5-f24b-4c8d-b1ce-5f65e07211dc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:23.952983 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ff66ca5-f24b-4c8d-b1ce-5f65e07211dc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.242832 Sep 08 13:55:23.953945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 203/416] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:23 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:24.264902 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-d7128f4f-026d-4d1a-acd1-951aa37c05eb req-5ecad21b-c565-4be7-8af8-53b2f57f0e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bead64-8c72-4cb8-806b-f68b2fc593cc", "tag": "97326033-4991-4b35-9df8-8c1194e9ebe7"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:24.273309 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-443e3b64-ff4a-4f67-bc8e-f38870c77ff9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:24.274327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-443e3b64-ff4a-4f67-bc8e-f38870c77ff9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:24.275486 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d7128f4f-026d-4d1a-acd1-951aa37c05eb req-5ecad21b-c565-4be7-8af8-53b2f57f0e07 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:24.275970 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d7128f4f-026d-4d1a-acd1-951aa37c05eb req-5ecad21b-c565-4be7-8af8-53b2f57f0e07 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:24.276391 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d7128f4f-026d-4d1a-acd1-951aa37c05eb req-5ecad21b-c565-4be7-8af8-53b2f57f0e07 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:24.282317 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-443e3b64-ff4a-4f67-bc8e-f38870c77ff9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:24.283466 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-443e3b64-ff4a-4f67-bc8e-f38870c77ff9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:24.285248 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-443e3b64-ff4a-4f67-bc8e-f38870c77ff9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:24.286313 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-443e3b64-ff4a-4f67-bc8e-f38870c77ff9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:24.287264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-443e3b64-ff4a-4f67-bc8e-f38870c77ff9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:24.287825 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-443e3b64-ff4a-4f67-bc8e-f38870c77ff9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:24.291054 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-d7128f4f-026d-4d1a-acd1-951aa37c05eb req-5ecad21b-c565-4be7-8af8-53b2f57f0e07 service nova] Creating event network-changed:97326033-4991-4b35-9df8-8c1194e9ebe7 for instance 21bead64-8c72-4cb8-806b-f68b2fc593cc on hv-cinder-82002 Sep 08 13:55:24.296608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-d7128f4f-026d-4d1a-acd1-951aa37c05eb req-5ecad21b-c565-4be7-8af8-53b2f57f0e07 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035549 Sep 08 13:55:24.297469 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 214/417] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:55:24.456046 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-443e3b64-ff4a-4f67-bc8e-f38870c77ff9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:24.463944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-443e3b64-ff4a-4f67-bc8e-f38870c77ff9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.195424 Sep 08 13:55:24.464570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 204/418] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:24 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:24.977071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-697386b2-d492-4f4b-8b81-a4b23b1a039d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:24.977795 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-697386b2-d492-4f4b-8b81-a4b23b1a039d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:24.983964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-697386b2-d492-4f4b-8b81-a4b23b1a039d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:24.984445 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-697386b2-d492-4f4b-8b81-a4b23b1a039d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:24.984878 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-697386b2-d492-4f4b-8b81-a4b23b1a039d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:24.985565 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-697386b2-d492-4f4b-8b81-a4b23b1a039d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:24.986046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-697386b2-d492-4f4b-8b81-a4b23b1a039d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:24.986465 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-697386b2-d492-4f4b-8b81-a4b23b1a039d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:25.120195 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-697386b2-d492-4f4b-8b81-a4b23b1a039d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:25.128790 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-697386b2-d492-4f4b-8b81-a4b23b1a039d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.156058 Sep 08 13:55:25.129356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 215/419] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:24 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:25.487503 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3338196d-c6f0-41f2-9c77-f2750041c3f3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:25.488103 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3338196d-c6f0-41f2-9c77-f2750041c3f3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:25.490396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:25.491213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=12 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:25.497454 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3338196d-c6f0-41f2-9c77-f2750041c3f3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:25.497950 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3338196d-c6f0-41f2-9c77-f2750041c3f3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:25.498380 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3338196d-c6f0-41f2-9c77-f2750041c3f3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:25.499051 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3338196d-c6f0-41f2-9c77-f2750041c3f3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:25.499495 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3338196d-c6f0-41f2-9c77-f2750041c3f3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:25.500459 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3338196d-c6f0-41f2-9c77-f2750041c3f3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:25.630566 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3338196d-c6f0-41f2-9c77-f2750041c3f3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:25.638096 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3338196d-c6f0-41f2-9c77-f2750041c3f3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.154901 Sep 08 13:55:25.638650 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 205/420] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:25 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:26.152181 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5dcb1570-cd9d-4c37-8d6b-3f02a756c44b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:26.152788 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5dcb1570-cd9d-4c37-8d6b-3f02a756c44b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:26.159150 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5dcb1570-cd9d-4c37-8d6b-3f02a756c44b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:26.159629 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5dcb1570-cd9d-4c37-8d6b-3f02a756c44b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:26.160060 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5dcb1570-cd9d-4c37-8d6b-3f02a756c44b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:26.160743 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5dcb1570-cd9d-4c37-8d6b-3f02a756c44b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:26.161195 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5dcb1570-cd9d-4c37-8d6b-3f02a756c44b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:26.161613 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5dcb1570-cd9d-4c37-8d6b-3f02a756c44b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:26.294183 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5dcb1570-cd9d-4c37-8d6b-3f02a756c44b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:26.302860 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5dcb1570-cd9d-4c37-8d6b-3f02a756c44b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.154480 Sep 08 13:55:26.303422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 216/421] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:26 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:26.660280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-362bab73-0142-4e14-a3f6-7bc8828fc1d4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:26.660906 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-362bab73-0142-4e14-a3f6-7bc8828fc1d4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:26.667241 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362bab73-0142-4e14-a3f6-7bc8828fc1d4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:26.667716 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362bab73-0142-4e14-a3f6-7bc8828fc1d4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:26.668143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362bab73-0142-4e14-a3f6-7bc8828fc1d4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:26.668818 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362bab73-0142-4e14-a3f6-7bc8828fc1d4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:26.669263 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362bab73-0142-4e14-a3f6-7bc8828fc1d4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:26.669682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-362bab73-0142-4e14-a3f6-7bc8828fc1d4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:26.795383 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-362bab73-0142-4e14-a3f6-7bc8828fc1d4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:26.803295 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-362bab73-0142-4e14-a3f6-7bc8828fc1d4 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.146862 Sep 08 13:55:26.803850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 206/422] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:26 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:27.326494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7a998447-4362-41a8-89bf-4b34e746c8a0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:27.327039 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7a998447-4362-41a8-89bf-4b34e746c8a0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:27.333432 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a998447-4362-41a8-89bf-4b34e746c8a0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:27.333938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a998447-4362-41a8-89bf-4b34e746c8a0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:27.334395 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a998447-4362-41a8-89bf-4b34e746c8a0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:27.335067 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a998447-4362-41a8-89bf-4b34e746c8a0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:27.335510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a998447-4362-41a8-89bf-4b34e746c8a0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:27.335921 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7a998447-4362-41a8-89bf-4b34e746c8a0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:27.353629 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:27.467320 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7a998447-4362-41a8-89bf-4b34e746c8a0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:27.475543 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7a998447-4362-41a8-89bf-4b34e746c8a0 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.153054 Sep 08 13:55:27.476108 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 217/423] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:27 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:27.826200 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01139ee4-f9ce-406a-ac4b-e0b60157f254 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:27.826854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-01139ee4-f9ce-406a-ac4b-e0b60157f254 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:27.833188 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01139ee4-f9ce-406a-ac4b-e0b60157f254 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:27.833674 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01139ee4-f9ce-406a-ac4b-e0b60157f254 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:27.834158 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01139ee4-f9ce-406a-ac4b-e0b60157f254 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:27.834851 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01139ee4-f9ce-406a-ac4b-e0b60157f254 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:27.835301 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01139ee4-f9ce-406a-ac4b-e0b60157f254 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:27.835724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01139ee4-f9ce-406a-ac4b-e0b60157f254 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:27.962538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-01139ee4-f9ce-406a-ac4b-e0b60157f254 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:27.970822 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-01139ee4-f9ce-406a-ac4b-e0b60157f254 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.148539 Sep 08 13:55:27.971375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 207/424] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:27 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:28.498422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6f78c30e-7d4d-44df-bdfa-6ef22ac84e19 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:28.499129 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6f78c30e-7d4d-44df-bdfa-6ef22ac84e19 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:28.505555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f78c30e-7d4d-44df-bdfa-6ef22ac84e19 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:28.506136 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f78c30e-7d4d-44df-bdfa-6ef22ac84e19 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:28.506572 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f78c30e-7d4d-44df-bdfa-6ef22ac84e19 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:28.507263 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f78c30e-7d4d-44df-bdfa-6ef22ac84e19 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:28.507717 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f78c30e-7d4d-44df-bdfa-6ef22ac84e19 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:28.508136 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6f78c30e-7d4d-44df-bdfa-6ef22ac84e19 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:28.668755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6f78c30e-7d4d-44df-bdfa-6ef22ac84e19 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:28.677914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6f78c30e-7d4d-44df-bdfa-6ef22ac84e19 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.183225 Sep 08 13:55:28.679017 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 218/425] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:28 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:28.994000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cd8ffe1-1a91-4110-a2bd-57e72f43d940 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:28.994538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0cd8ffe1-1a91-4110-a2bd-57e72f43d940 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:29.001356 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cd8ffe1-1a91-4110-a2bd-57e72f43d940 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:29.001881 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cd8ffe1-1a91-4110-a2bd-57e72f43d940 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:29.002314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cd8ffe1-1a91-4110-a2bd-57e72f43d940 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:29.003002 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cd8ffe1-1a91-4110-a2bd-57e72f43d940 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:29.003450 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cd8ffe1-1a91-4110-a2bd-57e72f43d940 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:29.003873 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cd8ffe1-1a91-4110-a2bd-57e72f43d940 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:29.135747 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0cd8ffe1-1a91-4110-a2bd-57e72f43d940 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:29.143357 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0cd8ffe1-1a91-4110-a2bd-57e72f43d940 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.153451 Sep 08 13:55:29.143952 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 208/426] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:28 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:29.702134 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6803ae42-e644-49a8-bee4-e214b429882d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:29.702747 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6803ae42-e644-49a8-bee4-e214b429882d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:29.709106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6803ae42-e644-49a8-bee4-e214b429882d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:29.709587 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6803ae42-e644-49a8-bee4-e214b429882d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:29.710063 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6803ae42-e644-49a8-bee4-e214b429882d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:29.710758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6803ae42-e644-49a8-bee4-e214b429882d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:29.711210 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6803ae42-e644-49a8-bee4-e214b429882d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:29.711630 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6803ae42-e644-49a8-bee4-e214b429882d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:29.837651 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6803ae42-e644-49a8-bee4-e214b429882d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:29.846065 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6803ae42-e644-49a8-bee4-e214b429882d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.147716 Sep 08 13:55:29.846632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 219/427] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:29 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:30.165804 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3b4bd5ef-b1bb-4815-8eb4-cd83a9892f6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:30.166408 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3b4bd5ef-b1bb-4815-8eb4-cd83a9892f6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:30.168683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:30.173847 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b4bd5ef-b1bb-4815-8eb4-cd83a9892f6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:30.174323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b4bd5ef-b1bb-4815-8eb4-cd83a9892f6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:30.174753 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b4bd5ef-b1bb-4815-8eb4-cd83a9892f6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:30.175434 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b4bd5ef-b1bb-4815-8eb4-cd83a9892f6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:30.175880 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b4bd5ef-b1bb-4815-8eb4-cd83a9892f6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:30.176294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3b4bd5ef-b1bb-4815-8eb4-cd83a9892f6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:30.304951 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3b4bd5ef-b1bb-4815-8eb4-cd83a9892f6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:30.312920 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3b4bd5ef-b1bb-4815-8eb4-cd83a9892f6f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.150918 Sep 08 13:55:30.313476 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 209/428] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:30 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:30.869481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2a0b4fb5-fbd8-429f-acfe-fea2782d1bb6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:30.870126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2a0b4fb5-fbd8-429f-acfe-fea2782d1bb6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:30.877181 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a0b4fb5-fbd8-429f-acfe-fea2782d1bb6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:30.877670 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a0b4fb5-fbd8-429f-acfe-fea2782d1bb6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:30.878127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a0b4fb5-fbd8-429f-acfe-fea2782d1bb6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:30.878815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a0b4fb5-fbd8-429f-acfe-fea2782d1bb6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:30.879270 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a0b4fb5-fbd8-429f-acfe-fea2782d1bb6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:30.879691 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2a0b4fb5-fbd8-429f-acfe-fea2782d1bb6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:31.009187 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2a0b4fb5-fbd8-429f-acfe-fea2782d1bb6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:31.017499 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2a0b4fb5-fbd8-429f-acfe-fea2782d1bb6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.151891 Sep 08 13:55:31.018095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 220/429] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:30 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:31.335366 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4330ec91-3970-401d-8f37-a2fe50d62991 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:31.335922 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4330ec91-3970-401d-8f37-a2fe50d62991 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:31.342567 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4330ec91-3970-401d-8f37-a2fe50d62991 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:31.343046 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4330ec91-3970-401d-8f37-a2fe50d62991 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:31.343526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4330ec91-3970-401d-8f37-a2fe50d62991 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:31.344731 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4330ec91-3970-401d-8f37-a2fe50d62991 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:31.345213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4330ec91-3970-401d-8f37-a2fe50d62991 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:31.345643 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4330ec91-3970-401d-8f37-a2fe50d62991 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:31.472110 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4330ec91-3970-401d-8f37-a2fe50d62991 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:31.479684 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4330ec91-3970-401d-8f37-a2fe50d62991 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.148250 Sep 08 13:55:31.480249 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 210/430] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:31 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:32.041517 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8bd5dce2-6274-4894-832e-5759338c51a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:32.042142 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8bd5dce2-6274-4894-832e-5759338c51a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:32.048967 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd5dce2-6274-4894-832e-5759338c51a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:32.049438 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd5dce2-6274-4894-832e-5759338c51a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:32.049896 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd5dce2-6274-4894-832e-5759338c51a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:32.050577 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd5dce2-6274-4894-832e-5759338c51a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:32.051048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd5dce2-6274-4894-832e-5759338c51a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:32.051459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8bd5dce2-6274-4894-832e-5759338c51a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:32.181461 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8bd5dce2-6274-4894-832e-5759338c51a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:32.190102 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8bd5dce2-6274-4894-832e-5759338c51a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.152468 Sep 08 13:55:32.190663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 221/431] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:32 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:32.502987 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3eeaecf1-7b5b-48df-830f-709a333dadc3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:32.503532 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3eeaecf1-7b5b-48df-830f-709a333dadc3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:32.510010 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eeaecf1-7b5b-48df-830f-709a333dadc3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:32.510496 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eeaecf1-7b5b-48df-830f-709a333dadc3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:32.510931 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eeaecf1-7b5b-48df-830f-709a333dadc3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:32.511619 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eeaecf1-7b5b-48df-830f-709a333dadc3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:32.512072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eeaecf1-7b5b-48df-830f-709a333dadc3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:32.512495 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eeaecf1-7b5b-48df-830f-709a333dadc3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:32.645239 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3eeaecf1-7b5b-48df-830f-709a333dadc3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:32.652853 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3eeaecf1-7b5b-48df-830f-709a333dadc3 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.154271 Sep 08 13:55:32.653414 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 211/432] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:32 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:33.214752 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9c85883e-dbf2-45df-8906-27066cc4990b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:33.215297 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9c85883e-dbf2-45df-8906-27066cc4990b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:33.221627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c85883e-dbf2-45df-8906-27066cc4990b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:33.222140 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c85883e-dbf2-45df-8906-27066cc4990b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:33.222572 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c85883e-dbf2-45df-8906-27066cc4990b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:33.223260 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c85883e-dbf2-45df-8906-27066cc4990b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:33.223712 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c85883e-dbf2-45df-8906-27066cc4990b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:33.224141 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9c85883e-dbf2-45df-8906-27066cc4990b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:33.354011 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9c85883e-dbf2-45df-8906-27066cc4990b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:33.362240 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9c85883e-dbf2-45df-8906-27066cc4990b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.151720 Sep 08 13:55:33.362800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 222/433] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:33 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:33.675542 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cadf4b43-923f-4cf8-ae6a-0c7d7ddc28e1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:33.676155 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cadf4b43-923f-4cf8-ae6a-0c7d7ddc28e1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:33.682555 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cadf4b43-923f-4cf8-ae6a-0c7d7ddc28e1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:33.683040 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cadf4b43-923f-4cf8-ae6a-0c7d7ddc28e1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:33.683476 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cadf4b43-923f-4cf8-ae6a-0c7d7ddc28e1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:33.684166 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cadf4b43-923f-4cf8-ae6a-0c7d7ddc28e1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:33.684692 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cadf4b43-923f-4cf8-ae6a-0c7d7ddc28e1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:33.685119 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cadf4b43-923f-4cf8-ae6a-0c7d7ddc28e1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:33.811719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cadf4b43-923f-4cf8-ae6a-0c7d7ddc28e1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:33.819858 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cadf4b43-923f-4cf8-ae6a-0c7d7ddc28e1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.148588 Sep 08 13:55:33.820366 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 212/434] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:33 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:34.385773 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e2ae6a0-b123-4614-9e4a-70387aa20c56 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:34.386475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e2ae6a0-b123-4614-9e4a-70387aa20c56 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:34.388774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=74 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:34.394510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e2ae6a0-b123-4614-9e4a-70387aa20c56 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:34.394985 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e2ae6a0-b123-4614-9e4a-70387aa20c56 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:34.395411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e2ae6a0-b123-4614-9e4a-70387aa20c56 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:34.396089 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e2ae6a0-b123-4614-9e4a-70387aa20c56 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:34.396536 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e2ae6a0-b123-4614-9e4a-70387aa20c56 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:34.396953 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e2ae6a0-b123-4614-9e4a-70387aa20c56 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:34.529592 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e2ae6a0-b123-4614-9e4a-70387aa20c56 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:34.538411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e2ae6a0-b123-4614-9e4a-70387aa20c56 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.156540 Sep 08 13:55:34.538981 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 223/435] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:34 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:34.842757 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a850e101-1fe4-4348-bd35-98304b5f44ba tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:34.843338 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a850e101-1fe4-4348-bd35-98304b5f44ba tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:34.849187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a850e101-1fe4-4348-bd35-98304b5f44ba tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:34.849663 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a850e101-1fe4-4348-bd35-98304b5f44ba tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:34.850146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a850e101-1fe4-4348-bd35-98304b5f44ba tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:34.850835 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a850e101-1fe4-4348-bd35-98304b5f44ba tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:34.851285 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a850e101-1fe4-4348-bd35-98304b5f44ba tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:34.851705 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a850e101-1fe4-4348-bd35-98304b5f44ba tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:34.981715 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a850e101-1fe4-4348-bd35-98304b5f44ba tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:34.989138 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a850e101-1fe4-4348-bd35-98304b5f44ba tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.150473 Sep 08 13:55:34.989689 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 213/436] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:34 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:35.562347 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d10b8229-c9dc-47d2-a75d-970d2affa4d2 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:35.562957 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d10b8229-c9dc-47d2-a75d-970d2affa4d2 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:35.569316 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d10b8229-c9dc-47d2-a75d-970d2affa4d2 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:35.569904 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d10b8229-c9dc-47d2-a75d-970d2affa4d2 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:35.570356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d10b8229-c9dc-47d2-a75d-970d2affa4d2 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:35.571043 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d10b8229-c9dc-47d2-a75d-970d2affa4d2 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:35.571499 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d10b8229-c9dc-47d2-a75d-970d2affa4d2 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:35.571917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d10b8229-c9dc-47d2-a75d-970d2affa4d2 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:35.777034 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d10b8229-c9dc-47d2-a75d-970d2affa4d2 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:35.785861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d10b8229-c9dc-47d2-a75d-970d2affa4d2 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.227360 Sep 08 13:55:35.786427 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 224/437] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:35 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:36.011588 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c249882-6098-4d7a-a365-5ba0543b3bb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:36.012200 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c249882-6098-4d7a-a365-5ba0543b3bb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:36.019528 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c249882-6098-4d7a-a365-5ba0543b3bb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:36.020009 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c249882-6098-4d7a-a365-5ba0543b3bb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:36.020447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c249882-6098-4d7a-a365-5ba0543b3bb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:36.021152 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c249882-6098-4d7a-a365-5ba0543b3bb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:36.021616 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c249882-6098-4d7a-a365-5ba0543b3bb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:36.022185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c249882-6098-4d7a-a365-5ba0543b3bb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:36.160092 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c249882-6098-4d7a-a365-5ba0543b3bb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:36.167551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c249882-6098-4d7a-a365-5ba0543b3bb5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.159825 Sep 08 13:55:36.168105 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 214/438] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:36 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:36.808415 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6e5d43e3-a47d-4349-8c3a-a143f56e8809 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:36.809054 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6e5d43e3-a47d-4349-8c3a-a143f56e8809 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:36.815480 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e5d43e3-a47d-4349-8c3a-a143f56e8809 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:36.815961 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e5d43e3-a47d-4349-8c3a-a143f56e8809 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:36.816394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e5d43e3-a47d-4349-8c3a-a143f56e8809 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:36.817082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e5d43e3-a47d-4349-8c3a-a143f56e8809 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:36.817531 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e5d43e3-a47d-4349-8c3a-a143f56e8809 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:36.817991 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6e5d43e3-a47d-4349-8c3a-a143f56e8809 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:36.990507 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6e5d43e3-a47d-4349-8c3a-a143f56e8809 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:36.998761 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6e5d43e3-a47d-4349-8c3a-a143f56e8809 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.194186 Sep 08 13:55:36.999857 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 225/439] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:36 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:37.190990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9c97812d-ce0c-47c5-8e50-8b5bd434236e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:37.191601 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9c97812d-ce0c-47c5-8e50-8b5bd434236e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:37.198220 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c97812d-ce0c-47c5-8e50-8b5bd434236e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:37.198708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c97812d-ce0c-47c5-8e50-8b5bd434236e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:37.199144 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c97812d-ce0c-47c5-8e50-8b5bd434236e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:37.199837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c97812d-ce0c-47c5-8e50-8b5bd434236e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:37.200296 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c97812d-ce0c-47c5-8e50-8b5bd434236e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:37.200722 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c97812d-ce0c-47c5-8e50-8b5bd434236e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:37.334426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9c97812d-ce0c-47c5-8e50-8b5bd434236e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:37.342497 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9c97812d-ce0c-47c5-8e50-8b5bd434236e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.156215 Sep 08 13:55:37.343070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 215/440] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:37 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:37.817222 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-113cc16c-288e-444c-9365-846052b4215d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:37.817721 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-113cc16c-288e-444c-9365-846052b4215d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:37.824019 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-113cc16c-288e-444c-9365-846052b4215d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:37.824499 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-113cc16c-288e-444c-9365-846052b4215d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:37.824934 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-113cc16c-288e-444c-9365-846052b4215d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:37.825623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-113cc16c-288e-444c-9365-846052b4215d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:37.826110 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-113cc16c-288e-444c-9365-846052b4215d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:37.826533 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-113cc16c-288e-444c-9365-846052b4215d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:37.953309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-113cc16c-288e-444c-9365-846052b4215d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lazy-loading 'services' on Instance uuid e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:55:38.023084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d57ec35e-de8b-4198-8820-ab737183cf39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:38.023826 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d57ec35e-de8b-4198-8820-ab737183cf39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:38.030033 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d57ec35e-de8b-4198-8820-ab737183cf39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:38.030712 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d57ec35e-de8b-4198-8820-ab737183cf39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:38.031742 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d57ec35e-de8b-4198-8820-ab737183cf39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:38.032556 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d57ec35e-de8b-4198-8820-ab737183cf39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:38.033117 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d57ec35e-de8b-4198-8820-ab737183cf39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:38.033621 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d57ec35e-de8b-4198-8820-ab737183cf39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:38.085727 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-113cc16c-288e-444c-9365-846052b4215d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef/os-volume_attachments/e8005484-e4aa-43c3-9993-f530e0c9111c" status: 202 len: 0 microversion: 2.1 time: 0.272246 Sep 08 13:55:38.086756 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 226/441] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 13:55:37 2022] DELETE /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef/os-volume_attachments/e8005484-e4aa-43c3-9993-f530e0c9111c => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:55:38.181435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d57ec35e-de8b-4198-8820-ab737183cf39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:38.189604 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d57ec35e-de8b-4198-8820-ab737183cf39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.171212 Sep 08 13:55:38.190186 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 216/442] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:38 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:38.364908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-85d9ba03-39f0-4541-8851-621b4d550289 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:38.365614 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-85d9ba03-39f0-4541-8851-621b4d550289 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:38.371800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d9ba03-39f0-4541-8851-621b4d550289 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:38.372285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d9ba03-39f0-4541-8851-621b4d550289 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:38.372720 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d9ba03-39f0-4541-8851-621b4d550289 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:38.373412 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d9ba03-39f0-4541-8851-621b4d550289 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:38.373895 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d9ba03-39f0-4541-8851-621b4d550289 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:38.374319 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-85d9ba03-39f0-4541-8851-621b4d550289 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:38.525452 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-85d9ba03-39f0-4541-8851-621b4d550289 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:38.533620 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-85d9ba03-39f0-4541-8851-621b4d550289 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.172958 Sep 08 13:55:38.534271 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 227/443] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:38 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:39.212212 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff2832e9-c959-49eb-abe1-6f5c4c75d8ba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:39.212828 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff2832e9-c959-49eb-abe1-6f5c4c75d8ba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:39.220053 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff2832e9-c959-49eb-abe1-6f5c4c75d8ba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:39.220540 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff2832e9-c959-49eb-abe1-6f5c4c75d8ba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:39.220979 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff2832e9-c959-49eb-abe1-6f5c4c75d8ba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:39.221675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff2832e9-c959-49eb-abe1-6f5c4c75d8ba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:39.222158 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff2832e9-c959-49eb-abe1-6f5c4c75d8ba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:39.222582 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff2832e9-c959-49eb-abe1-6f5c4c75d8ba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:39.355980 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ff2832e9-c959-49eb-abe1-6f5c4c75d8ba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:39.364679 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff2832e9-c959-49eb-abe1-6f5c4c75d8ba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.156314 Sep 08 13:55:39.365238 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 217/444] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:39 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:39.556762 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f520c8f4-bbe5-4f34-b1b4-3e2194afc383 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:39.557514 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f520c8f4-bbe5-4f34-b1b4-3e2194afc383 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:39.564412 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f520c8f4-bbe5-4f34-b1b4-3e2194afc383 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:39.565002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f520c8f4-bbe5-4f34-b1b4-3e2194afc383 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:39.565530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f520c8f4-bbe5-4f34-b1b4-3e2194afc383 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:39.566390 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f520c8f4-bbe5-4f34-b1b4-3e2194afc383 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:39.566939 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f520c8f4-bbe5-4f34-b1b4-3e2194afc383 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:39.567449 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f520c8f4-bbe5-4f34-b1b4-3e2194afc383 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:39.703334 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f520c8f4-bbe5-4f34-b1b4-3e2194afc383 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:39.710881 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f520c8f4-bbe5-4f34-b1b4-3e2194afc383 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.158465 Sep 08 13:55:39.711446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 228/445] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:39 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:40.271885 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-99997376-b7fb-49d3-bc3a-0fc88e590cae tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:40.272394 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-99997376-b7fb-49d3-bc3a-0fc88e590cae tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:40.278763 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99997376-b7fb-49d3-bc3a-0fc88e590cae tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:40.279246 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99997376-b7fb-49d3-bc3a-0fc88e590cae tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:40.279677 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99997376-b7fb-49d3-bc3a-0fc88e590cae tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:40.280361 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99997376-b7fb-49d3-bc3a-0fc88e590cae tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:40.280811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99997376-b7fb-49d3-bc3a-0fc88e590cae tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:40.281234 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-99997376-b7fb-49d3-bc3a-0fc88e590cae tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:40.285047 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:40.307967 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-99997376-b7fb-49d3-bc3a-0fc88e590cae tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:55:40.384071 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-99997376-b7fb-49d3-bc3a-0fc88e590cae tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 204 len: 0 microversion: 2.1 time: 0.115747 Sep 08 13:55:40.384875 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 218/446] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:55:40 2022] DELETE /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:55:40.388729 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c0912a97-55d6-4244-a0bb-50fb6a3773a1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:40.393094 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f65e12c8-5345-4238-a7bb-a3a94cafc279 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:40.393823 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f65e12c8-5345-4238-a7bb-a3a94cafc279 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:40.395902 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c0912a97-55d6-4244-a0bb-50fb6a3773a1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:40.399831 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65e12c8-5345-4238-a7bb-a3a94cafc279 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:40.400314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65e12c8-5345-4238-a7bb-a3a94cafc279 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:40.400750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65e12c8-5345-4238-a7bb-a3a94cafc279 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:40.401448 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65e12c8-5345-4238-a7bb-a3a94cafc279 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:40.401966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65e12c8-5345-4238-a7bb-a3a94cafc279 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:40.402393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f65e12c8-5345-4238-a7bb-a3a94cafc279 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:40.405622 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0912a97-55d6-4244-a0bb-50fb6a3773a1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:40.406517 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0912a97-55d6-4244-a0bb-50fb6a3773a1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:40.407326 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0912a97-55d6-4244-a0bb-50fb6a3773a1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:40.408566 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0912a97-55d6-4244-a0bb-50fb6a3773a1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:40.409588 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0912a97-55d6-4244-a0bb-50fb6a3773a1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:40.410371 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c0912a97-55d6-4244-a0bb-50fb6a3773a1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:40.609065 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f65e12c8-5345-4238-a7bb-a3a94cafc279 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:40.617248 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f65e12c8-5345-4238-a7bb-a3a94cafc279 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1513 microversion: 2.1 time: 0.228231 Sep 08 13:55:40.618028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 219/447] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:40 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:40.622308 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-627be6d1-0ebe-4d74-8e81-144c5df16fd6 req-d0c315c1-2f56-4dc2-b039-75a7261425bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bead64-8c72-4cb8-806b-f68b2fc593cc", "name": "network-vif-plugged", "status": "completed", "tag": "97326033-4991-4b35-9df8-8c1194e9ebe7"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:40.634569 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c0912a97-55d6-4244-a0bb-50fb6a3773a1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:40.639235 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-627be6d1-0ebe-4d74-8e81-144c5df16fd6 req-d0c315c1-2f56-4dc2-b039-75a7261425bf service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:40.639713 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-627be6d1-0ebe-4d74-8e81-144c5df16fd6 req-d0c315c1-2f56-4dc2-b039-75a7261425bf service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:40.640173 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-627be6d1-0ebe-4d74-8e81-144c5df16fd6 req-d0c315c1-2f56-4dc2-b039-75a7261425bf service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:40.644131 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c0912a97-55d6-4244-a0bb-50fb6a3773a1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.260439 Sep 08 13:55:40.645467 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 229/448] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:40 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:40.656151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-627be6d1-0ebe-4d74-8e81-144c5df16fd6 req-d0c315c1-2f56-4dc2-b039-75a7261425bf service nova] Creating event network-vif-plugged:97326033-4991-4b35-9df8-8c1194e9ebe7 for instance 21bead64-8c72-4cb8-806b-f68b2fc593cc on hv-cinder-82002 Sep 08 13:55:40.663076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-627be6d1-0ebe-4d74-8e81-144c5df16fd6 req-d0c315c1-2f56-4dc2-b039-75a7261425bf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044078 Sep 08 13:55:40.663970 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 220/449] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:55:40.734490 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4b3e7dda-7bb5-498b-a978-44666ff9214e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:40.735022 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4b3e7dda-7bb5-498b-a978-44666ff9214e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:40.741414 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b3e7dda-7bb5-498b-a978-44666ff9214e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:40.741938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b3e7dda-7bb5-498b-a978-44666ff9214e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:40.742371 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b3e7dda-7bb5-498b-a978-44666ff9214e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:40.743089 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b3e7dda-7bb5-498b-a978-44666ff9214e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:40.743594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b3e7dda-7bb5-498b-a978-44666ff9214e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:40.744016 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4b3e7dda-7bb5-498b-a978-44666ff9214e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:40.875528 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-4b3e7dda-7bb5-498b-a978-44666ff9214e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:40.883170 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4b3e7dda-7bb5-498b-a978-44666ff9214e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.152520 Sep 08 13:55:40.883734 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 230/450] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:40 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:41.643514 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de0d3ff2-95cd-4cca-820a-a62482c91a46 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:41.644401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-de0d3ff2-95cd-4cca-820a-a62482c91a46 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:41.652461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de0d3ff2-95cd-4cca-820a-a62482c91a46 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:41.652946 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de0d3ff2-95cd-4cca-820a-a62482c91a46 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:41.653379 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de0d3ff2-95cd-4cca-820a-a62482c91a46 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:41.654172 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de0d3ff2-95cd-4cca-820a-a62482c91a46 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:41.654623 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de0d3ff2-95cd-4cca-820a-a62482c91a46 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:41.655043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de0d3ff2-95cd-4cca-820a-a62482c91a46 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:41.668442 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ca63832-7de7-42f1-84c1-2354eb47be39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:41.669047 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ca63832-7de7-42f1-84c1-2354eb47be39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:41.676081 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca63832-7de7-42f1-84c1-2354eb47be39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:41.676561 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca63832-7de7-42f1-84c1-2354eb47be39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:41.676993 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca63832-7de7-42f1-84c1-2354eb47be39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:41.677679 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca63832-7de7-42f1-84c1-2354eb47be39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:41.678212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca63832-7de7-42f1-84c1-2354eb47be39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:41.678623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ca63832-7de7-42f1-84c1-2354eb47be39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:41.862628 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-de0d3ff2-95cd-4cca-820a-a62482c91a46 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:41.865589 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9ca63832-7de7-42f1-84c1-2354eb47be39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:41.870341 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-de0d3ff2-95cd-4cca-820a-a62482c91a46 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1513 microversion: 2.1 time: 0.232602 Sep 08 13:55:41.870912 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 221/451] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:41 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:41.874019 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ca63832-7de7-42f1-84c1-2354eb47be39 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.209648 Sep 08 13:55:41.874653 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 231/452] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:41 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:41.906527 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3ff2c7c-f369-4df2-8f93-6c33c1e65657 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:41.907138 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3ff2c7c-f369-4df2-8f93-6c33c1e65657 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:41.913067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3ff2c7c-f369-4df2-8f93-6c33c1e65657 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:41.913548 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3ff2c7c-f369-4df2-8f93-6c33c1e65657 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:41.914017 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3ff2c7c-f369-4df2-8f93-6c33c1e65657 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:41.914710 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3ff2c7c-f369-4df2-8f93-6c33c1e65657 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:41.915164 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3ff2c7c-f369-4df2-8f93-6c33c1e65657 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:41.915587 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3ff2c7c-f369-4df2-8f93-6c33c1e65657 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:42.043978 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3ff2c7c-f369-4df2-8f93-6c33c1e65657 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:42.052077 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3ff2c7c-f369-4df2-8f93-6c33c1e65657 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.149821 Sep 08 13:55:42.052636 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 222/453] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:41 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:42.893642 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38f3d7e2-ae71-4c0d-9c9b-f729b0efb5eb tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:42.894279 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38f3d7e2-ae71-4c0d-9c9b-f729b0efb5eb tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:42.896711 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e87bd9c4-c2ee-495c-ae8d-3976fa0fe23a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:42.897822 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e87bd9c4-c2ee-495c-ae8d-3976fa0fe23a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:42.901439 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38f3d7e2-ae71-4c0d-9c9b-f729b0efb5eb tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:42.902045 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38f3d7e2-ae71-4c0d-9c9b-f729b0efb5eb tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:42.902388 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38f3d7e2-ae71-4c0d-9c9b-f729b0efb5eb tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:42.903082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38f3d7e2-ae71-4c0d-9c9b-f729b0efb5eb tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:42.903445 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e87bd9c4-c2ee-495c-ae8d-3976fa0fe23a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:42.903551 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38f3d7e2-ae71-4c0d-9c9b-f729b0efb5eb tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:42.903937 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38f3d7e2-ae71-4c0d-9c9b-f729b0efb5eb tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:42.904059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e87bd9c4-c2ee-495c-ae8d-3976fa0fe23a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:42.904371 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e87bd9c4-c2ee-495c-ae8d-3976fa0fe23a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:42.905073 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e87bd9c4-c2ee-495c-ae8d-3976fa0fe23a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:42.905568 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e87bd9c4-c2ee-495c-ae8d-3976fa0fe23a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:42.906535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e87bd9c4-c2ee-495c-ae8d-3976fa0fe23a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:43.103332 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e87bd9c4-c2ee-495c-ae8d-3976fa0fe23a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:43.107293 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-38f3d7e2-ae71-4c0d-9c9b-f729b0efb5eb tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:43.111553 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e87bd9c4-c2ee-495c-ae8d-3976fa0fe23a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.218703 Sep 08 13:55:43.116513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 223/454] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:42 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:43.116651 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38f3d7e2-ae71-4c0d-9c9b-f729b0efb5eb tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1513 microversion: 2.1 time: 0.226557 Sep 08 13:55:43.116651 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 232/455] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:42 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:43.116819 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9582e633-519b-4221-8bbb-3c9419172707 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:43.117161 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9582e633-519b-4221-8bbb-3c9419172707 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:43.123071 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9582e633-519b-4221-8bbb-3c9419172707 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:43.123562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9582e633-519b-4221-8bbb-3c9419172707 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:43.124011 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9582e633-519b-4221-8bbb-3c9419172707 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:43.125209 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9582e633-519b-4221-8bbb-3c9419172707 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:43.125663 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9582e633-519b-4221-8bbb-3c9419172707 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:43.126305 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9582e633-519b-4221-8bbb-3c9419172707 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:43.253102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9582e633-519b-4221-8bbb-3c9419172707 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:43.260584 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9582e633-519b-4221-8bbb-3c9419172707 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.147519 Sep 08 13:55:43.261151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 224/456] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:43 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:44.134561 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fb2e980f-05d8-4140-a8fa-76a0a368a55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:44.135167 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fb2e980f-05d8-4140-a8fa-76a0a368a55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:44.138532 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f456ec11-def0-490f-951c-a2aa88ef191a tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:44.139199 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f456ec11-def0-490f-951c-a2aa88ef191a tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:44.141689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb2e980f-05d8-4140-a8fa-76a0a368a55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:44.142198 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb2e980f-05d8-4140-a8fa-76a0a368a55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:44.142663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb2e980f-05d8-4140-a8fa-76a0a368a55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:44.143348 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb2e980f-05d8-4140-a8fa-76a0a368a55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:44.143791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb2e980f-05d8-4140-a8fa-76a0a368a55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:44.144209 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fb2e980f-05d8-4140-a8fa-76a0a368a55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:44.145681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f456ec11-def0-490f-951c-a2aa88ef191a tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:44.146187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f456ec11-def0-490f-951c-a2aa88ef191a tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:44.146628 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f456ec11-def0-490f-951c-a2aa88ef191a tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:44.147317 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f456ec11-def0-490f-951c-a2aa88ef191a tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:44.147779 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f456ec11-def0-490f-951c-a2aa88ef191a tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:44.148207 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f456ec11-def0-490f-951c-a2aa88ef191a tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:44.163236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:44.340310 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f456ec11-def0-490f-951c-a2aa88ef191a tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:44.344030 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-fb2e980f-05d8-4140-a8fa-76a0a368a55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:44.352665 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f456ec11-def0-490f-951c-a2aa88ef191a tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1513 microversion: 2.1 time: 0.217818 Sep 08 13:55:44.353288 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 225/457] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:44 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:44.354167 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fb2e980f-05d8-4140-a8fa-76a0a368a55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.222940 Sep 08 13:55:44.355221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 233/458] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:44 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:44.359775 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a67ee38-ad9e-44b4-8405-1633cb6e24a6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:44.360381 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8a67ee38-ad9e-44b4-8405-1633cb6e24a6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:44.366436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a67ee38-ad9e-44b4-8405-1633cb6e24a6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:44.366923 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a67ee38-ad9e-44b4-8405-1633cb6e24a6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:44.367357 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a67ee38-ad9e-44b4-8405-1633cb6e24a6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:44.368059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a67ee38-ad9e-44b4-8405-1633cb6e24a6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:44.368510 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a67ee38-ad9e-44b4-8405-1633cb6e24a6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:44.368936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a67ee38-ad9e-44b4-8405-1633cb6e24a6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:44.500610 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8a67ee38-ad9e-44b4-8405-1633cb6e24a6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:44.508112 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8a67ee38-ad9e-44b4-8405-1633cb6e24a6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.153856 Sep 08 13:55:44.508666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 226/459] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:44 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:45.376133 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b898708-0b4d-4981-80c0-8043b8167bd6 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:45.376780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b898708-0b4d-4981-80c0-8043b8167bd6 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:45.378573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-746a1910-c6be-49e3-83b2-d2560fdf48f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:45.379181 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-746a1910-c6be-49e3-83b2-d2560fdf48f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:45.383263 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b898708-0b4d-4981-80c0-8043b8167bd6 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:45.383748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b898708-0b4d-4981-80c0-8043b8167bd6 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:45.384182 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b898708-0b4d-4981-80c0-8043b8167bd6 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:45.384879 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b898708-0b4d-4981-80c0-8043b8167bd6 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:45.385325 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b898708-0b4d-4981-80c0-8043b8167bd6 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:45.385443 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-746a1910-c6be-49e3-83b2-d2560fdf48f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:45.385766 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b898708-0b4d-4981-80c0-8043b8167bd6 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:45.385957 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-746a1910-c6be-49e3-83b2-d2560fdf48f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:45.386391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-746a1910-c6be-49e3-83b2-d2560fdf48f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:45.387101 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-746a1910-c6be-49e3-83b2-d2560fdf48f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:45.387548 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-746a1910-c6be-49e3-83b2-d2560fdf48f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:45.387966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-746a1910-c6be-49e3-83b2-d2560fdf48f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:45.582434 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9b898708-0b4d-4981-80c0-8043b8167bd6 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:45.586428 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-746a1910-c6be-49e3-83b2-d2560fdf48f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:45.590369 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b898708-0b4d-4981-80c0-8043b8167bd6 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1513 microversion: 2.1 time: 0.218565 Sep 08 13:55:45.591024 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 234/460] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:45 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:45.595039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-746a1910-c6be-49e3-83b2-d2560fdf48f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1722 microversion: 2.1 time: 0.220886 Sep 08 13:55:45.595464 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e513ac9-e2d8-4467-9762-22ed01925687 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:45.596168 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e513ac9-e2d8-4467-9762-22ed01925687 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:45.601757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e513ac9-e2d8-4467-9762-22ed01925687 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:45.602260 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e513ac9-e2d8-4467-9762-22ed01925687 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:45.602684 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e513ac9-e2d8-4467-9762-22ed01925687 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:45.603372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e513ac9-e2d8-4467-9762-22ed01925687 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:45.603825 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e513ac9-e2d8-4467-9762-22ed01925687 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:45.604247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e513ac9-e2d8-4467-9762-22ed01925687 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:45.609918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 227/461] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:45 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:45.735494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7e513ac9-e2d8-4467-9762-22ed01925687 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:45.742959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e513ac9-e2d8-4467-9762-22ed01925687 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.151008 Sep 08 13:55:45.743576 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 235/462] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:45 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:46.613725 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e242648-fc0d-4b80-a69e-2d57f828c133 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:46.614399 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0e242648-fc0d-4b80-a69e-2d57f828c133 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:46.618179 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc6c9279-3568-4193-9107-5e772a664481 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:46.618795 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bc6c9279-3568-4193-9107-5e772a664481 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:46.627717 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc6c9279-3568-4193-9107-5e772a664481 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:46.628001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e242648-fc0d-4b80-a69e-2d57f828c133 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:46.628107 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc6c9279-3568-4193-9107-5e772a664481 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:46.628196 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc6c9279-3568-4193-9107-5e772a664481 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:46.628892 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc6c9279-3568-4193-9107-5e772a664481 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:46.629397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc6c9279-3568-4193-9107-5e772a664481 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:46.629839 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc6c9279-3568-4193-9107-5e772a664481 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:46.633196 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e242648-fc0d-4b80-a69e-2d57f828c133 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:46.633665 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e242648-fc0d-4b80-a69e-2d57f828c133 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:46.635691 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e242648-fc0d-4b80-a69e-2d57f828c133 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:46.635691 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e242648-fc0d-4b80-a69e-2d57f828c133 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:46.635691 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0e242648-fc0d-4b80-a69e-2d57f828c133 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:46.726476 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0e242648-fc0d-4b80-a69e-2d57f828c133 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:46.735024 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0e242648-fc0d-4b80-a69e-2d57f828c133 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1471 microversion: 2.1 time: 0.125309 Sep 08 13:55:46.735603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 228/463] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:46 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1471 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:46.740080 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-043cc61d-c132-4916-805b-b513c84b7b3f req-9f9c78a6-d5f3-4832-9348-c71d1fe97c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef", "name": "network-vif-deleted", "tag": "0677f870-39bb-4655-b43d-ef2acf0f9f1b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:46.749348 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-043cc61d-c132-4916-805b-b513c84b7b3f req-9f9c78a6-d5f3-4832-9348-c71d1fe97c66 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:46.749850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-043cc61d-c132-4916-805b-b513c84b7b3f req-9f9c78a6-d5f3-4832-9348-c71d1fe97c66 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:46.750282 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-043cc61d-c132-4916-805b-b513c84b7b3f req-9f9c78a6-d5f3-4832-9348-c71d1fe97c66 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:46.760947 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-043cc61d-c132-4916-805b-b513c84b7b3f req-9f9c78a6-d5f3-4832-9348-c71d1fe97c66 service nova] Creating event network-vif-deleted:0677f870-39bb-4655-b43d-ef2acf0f9f1b for instance e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef on hv-cinder-82002 Sep 08 13:55:46.766086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-043cc61d-c132-4916-805b-b513c84b7b3f req-9f9c78a6-d5f3-4832-9348-c71d1fe97c66 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029319 Sep 08 13:55:46.766902 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 229/464] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:55:46.772150 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b3303b9e-0adc-4f4a-b8f6-abc07726b29f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:46.772959 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b3303b9e-0adc-4f4a-b8f6-abc07726b29f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:46.779266 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3303b9e-0adc-4f4a-b8f6-abc07726b29f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:46.779765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3303b9e-0adc-4f4a-b8f6-abc07726b29f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:46.780206 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3303b9e-0adc-4f4a-b8f6-abc07726b29f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:46.781400 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3303b9e-0adc-4f4a-b8f6-abc07726b29f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:46.781883 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3303b9e-0adc-4f4a-b8f6-abc07726b29f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:46.782309 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b3303b9e-0adc-4f4a-b8f6-abc07726b29f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:46.793349 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-bc6c9279-3568-4193-9107-5e772a664481 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:46.802216 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc6c9279-3568-4193-9107-5e772a664481 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1699 microversion: 2.1 time: 0.188330 Sep 08 13:55:46.802791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 236/465] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:46 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1699 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:46.827752 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1838e15a-4cfd-47e4-a650-36d5467eff27 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:46.834861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1838e15a-4cfd-47e4-a650-36d5467eff27 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:46.835352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1838e15a-4cfd-47e4-a650-36d5467eff27 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:46.835787 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1838e15a-4cfd-47e4-a650-36d5467eff27 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:46.904641 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1838e15a-4cfd-47e4-a650-36d5467eff27 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Going to try to start instance {{(pid=126919) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 13:55:46.917131 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b3303b9e-0adc-4f4a-b8f6-abc07726b29f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:46.925846 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b3303b9e-0adc-4f4a-b8f6-abc07726b29f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1370 microversion: 2.1 time: 0.157598 Sep 08 13:55:46.926730 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 230/466] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:46 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:46.949183 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1838e15a-4cfd-47e4-a650-36d5467eff27 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "POST /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/action" status: 202 len: 0 microversion: 2.1 time: 0.125034 Sep 08 13:55:46.950603 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 237/467] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:55:46 2022] POST /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:55:46.957849 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e1e3c4f6-1e79-41c4-9656-c7e510ec8da6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:46.958460 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e1e3c4f6-1e79-41c4-9656-c7e510ec8da6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:46.964680 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1e3c4f6-1e79-41c4-9656-c7e510ec8da6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:46.965158 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1e3c4f6-1e79-41c4-9656-c7e510ec8da6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:46.965596 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1e3c4f6-1e79-41c4-9656-c7e510ec8da6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:46.966325 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1e3c4f6-1e79-41c4-9656-c7e510ec8da6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:46.966777 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1e3c4f6-1e79-41c4-9656-c7e510ec8da6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:46.967199 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e1e3c4f6-1e79-41c4-9656-c7e510ec8da6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:47.101540 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e1e3c4f6-1e79-41c4-9656-c7e510ec8da6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:47.109591 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e1e3c4f6-1e79-41c4-9656-c7e510ec8da6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1708 microversion: 2.1 time: 0.155648 Sep 08 13:55:47.110193 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 231/468] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:46 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:47.758039 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8628d08e-50de-43ef-a1a1-f9af45a23df3 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:47.758671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8628d08e-50de-43ef-a1a1-f9af45a23df3 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:47.765280 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8628d08e-50de-43ef-a1a1-f9af45a23df3 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:47.765793 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8628d08e-50de-43ef-a1a1-f9af45a23df3 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:47.766231 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8628d08e-50de-43ef-a1a1-f9af45a23df3 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:47.766924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8628d08e-50de-43ef-a1a1-f9af45a23df3 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:47.767374 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8628d08e-50de-43ef-a1a1-f9af45a23df3 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:47.767791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8628d08e-50de-43ef-a1a1-f9af45a23df3 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:47.829477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8628d08e-50de-43ef-a1a1-f9af45a23df3 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:47.837850 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8628d08e-50de-43ef-a1a1-f9af45a23df3 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1471 microversion: 2.1 time: 0.084075 Sep 08 13:55:47.838974 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 238/469] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:47 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:47.949826 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aa26fcf0-a8a6-4828-9738-30fe1718bae9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:47.950437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aa26fcf0-a8a6-4828-9738-30fe1718bae9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:47.957429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa26fcf0-a8a6-4828-9738-30fe1718bae9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:47.957948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa26fcf0-a8a6-4828-9738-30fe1718bae9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:47.958380 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa26fcf0-a8a6-4828-9738-30fe1718bae9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:47.959064 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa26fcf0-a8a6-4828-9738-30fe1718bae9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:47.959509 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa26fcf0-a8a6-4828-9738-30fe1718bae9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:47.959928 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aa26fcf0-a8a6-4828-9738-30fe1718bae9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:48.090639 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-aa26fcf0-a8a6-4828-9738-30fe1718bae9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:48.099132 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aa26fcf0-a8a6-4828-9738-30fe1718bae9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1564 microversion: 2.1 time: 0.153249 Sep 08 13:55:48.099704 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 232/470] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:47 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:48.122110 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-60ade156-9b6c-40a5-b157-a7bbb794201b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:48.122608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-60ade156-9b6c-40a5-b157-a7bbb794201b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:48.128904 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ade156-9b6c-40a5-b157-a7bbb794201b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:48.129388 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ade156-9b6c-40a5-b157-a7bbb794201b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:48.129854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ade156-9b6c-40a5-b157-a7bbb794201b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:48.130729 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ade156-9b6c-40a5-b157-a7bbb794201b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:48.131182 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ade156-9b6c-40a5-b157-a7bbb794201b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:48.131602 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-60ade156-9b6c-40a5-b157-a7bbb794201b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:48.132311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9ebd7e9-c53f-4850-8a46-fec07e57610f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:48.132914 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9ebd7e9-c53f-4850-8a46-fec07e57610f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:48.138767 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ebd7e9-c53f-4850-8a46-fec07e57610f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:48.139242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ebd7e9-c53f-4850-8a46-fec07e57610f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:48.140220 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ebd7e9-c53f-4850-8a46-fec07e57610f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:48.140905 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ebd7e9-c53f-4850-8a46-fec07e57610f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:48.141351 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ebd7e9-c53f-4850-8a46-fec07e57610f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:48.141787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9ebd7e9-c53f-4850-8a46-fec07e57610f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:48.242728 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-60ade156-9b6c-40a5-b157-a7bbb794201b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124910 Sep 08 13:55:48.243559 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 239/471] 10.222.0.55 () {58 vars in 1275 bytes} [Thu Sep 8 13:55:48 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:55:48.345538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9ebd7e9-c53f-4850-8a46-fec07e57610f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:48.356802 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9ebd7e9-c53f-4850-8a46-fec07e57610f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1708 microversion: 2.1 time: 0.228121 Sep 08 13:55:48.358154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 233/472] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:48 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1708 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:48.863198 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:48.865566 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:48.875050 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:48.875681 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:48.876353 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:48.877071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:48.877512 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:48.878127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:48.924335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:48.924900 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:48.925364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:48.925869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lazy-loading 'fault' on Instance uuid e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:55:48.977304 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:48.985908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-73061261-dd0b-4497-9ade-2980a56ed6cf tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 200 len: 1308 microversion: 2.1 time: 0.129070 Sep 08 13:55:48.986493 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 240/473] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:48 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:49.380338 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-750b4955-70aa-4b6f-adc5-7b5115eef2fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:49.380953 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-750b4955-70aa-4b6f-adc5-7b5115eef2fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:49.387502 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750b4955-70aa-4b6f-adc5-7b5115eef2fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:49.387990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750b4955-70aa-4b6f-adc5-7b5115eef2fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:49.388428 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750b4955-70aa-4b6f-adc5-7b5115eef2fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:49.389129 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750b4955-70aa-4b6f-adc5-7b5115eef2fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:49.390884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750b4955-70aa-4b6f-adc5-7b5115eef2fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:49.391317 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-750b4955-70aa-4b6f-adc5-7b5115eef2fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:49.414185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:49.458297 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e155644f-c05a-4f27-959e-2874c738f3ab req-4dce6629-cdc7-46d7-bfa6-d75e4c2b9846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bead64-8c72-4cb8-806b-f68b2fc593cc", "tag": "97326033-4991-4b35-9df8-8c1194e9ebe7"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:49.469204 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e155644f-c05a-4f27-959e-2874c738f3ab req-4dce6629-cdc7-46d7-bfa6-d75e4c2b9846 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:49.469907 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e155644f-c05a-4f27-959e-2874c738f3ab req-4dce6629-cdc7-46d7-bfa6-d75e4c2b9846 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:49.470436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e155644f-c05a-4f27-959e-2874c738f3ab req-4dce6629-cdc7-46d7-bfa6-d75e4c2b9846 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:49.482094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e155644f-c05a-4f27-959e-2874c738f3ab req-4dce6629-cdc7-46d7-bfa6-d75e4c2b9846 service nova] Creating event network-changed:97326033-4991-4b35-9df8-8c1194e9ebe7 for instance 21bead64-8c72-4cb8-806b-f68b2fc593cc on hv-cinder-82002 Sep 08 13:55:49.487677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e155644f-c05a-4f27-959e-2874c738f3ab req-4dce6629-cdc7-46d7-bfa6-d75e4c2b9846 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033163 Sep 08 13:55:49.488639 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 241/474] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:55:49.556776 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-750b4955-70aa-4b6f-adc5-7b5115eef2fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:49.565943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-750b4955-70aa-4b6f-adc5-7b5115eef2fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1708 microversion: 2.1 time: 0.189309 Sep 08 13:55:49.566442 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 234/475] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:49 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1708 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:50.014415 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:50.016488 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:50.023958 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:50.024460 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:50.024899 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:50.025599 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:50.026324 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:50.026745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:50.043270 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] HTTP exception thrown: Instance e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef could not be found. Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Request method failure captured: Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef HTTP/1.1 Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfP-qFAIKKmruQX512LwbyxgfLxfm_KyJHARo4HQLbvikwq-3AoP3kgUzKZ2TLvfK6hFRMMOBfN2LDR7IAVv8B81YD_mdJlAIFORM1mhUO_tMDwV_C8hZ4335mk5ZHI7r3OmynlB9EQ-jo-YRcXX9681tnAM_gV9UsYd3_eD9ZgPFpo Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 0375e7ef3fb04600b5d4095057658bc7 Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesSnapshotTestJSON-251370117 Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:55:50.045444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0375e7ef3fb04600b5d4095057658bc7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0375e7ef3fb04600b5d4095057658bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0375e7ef3fb04600b5d4095057658bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0375e7ef3fb04600b5d4095057658bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-VolumesSnapshotTestJSON-251370117 Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 0375e7ef3fb04600b5d4095057658bc7 Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-251370117 Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-VolumesSnapshotTestJSON-251370117-project Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: e93b5304ecec4ceca33da4b58e8e2480 Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-VolumesSnapshotTestJSON-251370117-project Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef could not be found. Sep 08 13:55:50.047530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': 'e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef'} Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef could not be found. Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:50.052359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef could not be found. Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef could not be found. Sep 08 13:55:50.053826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:55:50.055257 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Returning 404 to user: Instance e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:50.055257 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e81a37c-ae0e-4a56-a361-47be3f09ab24 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef" status: 404 len: 111 microversion: 2.1 time: 0.041200 Sep 08 13:55:50.055257 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 242/476] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:50 2022] GET /compute/v2.1/servers/e6d8d3c8-d06d-46c4-bcfb-7c64e618aeef => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:55:50.588622 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d513ca3-3a59-4dea-b824-fb4b6a5e8604 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:50.589251 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0d513ca3-3a59-4dea-b824-fb4b6a5e8604 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:50.596662 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d513ca3-3a59-4dea-b824-fb4b6a5e8604 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:50.597411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d513ca3-3a59-4dea-b824-fb4b6a5e8604 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:50.597883 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d513ca3-3a59-4dea-b824-fb4b6a5e8604 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:50.598594 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d513ca3-3a59-4dea-b824-fb4b6a5e8604 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:50.599052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d513ca3-3a59-4dea-b824-fb4b6a5e8604 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:50.599475 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d513ca3-3a59-4dea-b824-fb4b6a5e8604 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:50.740453 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d513ca3-3a59-4dea-b824-fb4b6a5e8604 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:50.748654 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d513ca3-3a59-4dea-b824-fb4b6a5e8604 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1712 microversion: 2.1 time: 0.164135 Sep 08 13:55:50.749254 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 235/477] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:50 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1712 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:00.995493 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1963556245", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "networks": [{"uuid": "27a47ec4-fdfa-4d05-bf7d-7362b88969c5"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:01.006809 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=41 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:01.007862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:01.055072 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] validate_networks() for [('27a47ec4-fdfa-4d05-bf7d-7362b88969c5', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:56:01.399004 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:56:01.399424 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:56:01.399922 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:56:01.400324 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:56:01.400729 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:56:01.409332 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:01.409844 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:01.410275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:01.410992 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:01.411439 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:01.411852 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:01.428853 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Getting quotas for project 0375e7ef3fb04600b5d4095057658bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:56:01.432790 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Getting quotas for user e93b5304ecec4ceca33da4b58e8e2480 and project 0375e7ef3fb04600b5d4095057658bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:56:01.443946 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:56:01.446255 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:56:01.489323 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [8751046e-ab3f-4efd-9852-78feb66768a5] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 13:56:02.496236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [8751046e-ab3f-4efd-9852-78feb66768a5] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 37266. Sep 08 13:56:02.500526 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2568c5ff-0b03-4d12-a994-b3599c87d0fe tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.508963 Sep 08 13:56:02.501158 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 243/478] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:56:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:56:02.512092 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be4f7b96-d714-4606-b66a-286292f2b62b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:02.512714 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be4f7b96-d714-4606-b66a-286292f2b62b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:02.516597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:02.517297 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=8 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:02.573859 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-be4f7b96-d714-4606-b66a-286292f2b62b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:02.581339 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be4f7b96-d714-4606-b66a-286292f2b62b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1219 microversion: 2.1 time: 0.073112 Sep 08 13:56:02.582036 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 236/479] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:02 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:03.604680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ecc00def-93dc-420b-96df-c28960712384 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:03.605297 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ecc00def-93dc-420b-96df-c28960712384 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:03.612184 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecc00def-93dc-420b-96df-c28960712384 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:03.612667 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecc00def-93dc-420b-96df-c28960712384 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:03.613104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecc00def-93dc-420b-96df-c28960712384 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:03.613834 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecc00def-93dc-420b-96df-c28960712384 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:03.614293 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecc00def-93dc-420b-96df-c28960712384 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:03.614716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ecc00def-93dc-420b-96df-c28960712384 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:03.674434 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ecc00def-93dc-420b-96df-c28960712384 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:03.681940 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ecc00def-93dc-420b-96df-c28960712384 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1271 microversion: 2.1 time: 0.081767 Sep 08 13:56:03.682502 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 244/480] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:03 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:04.704777 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de9ec990-ad1d-47c8-a9dd-603349b998bd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:04.705447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-de9ec990-ad1d-47c8-a9dd-603349b998bd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:04.711682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9ec990-ad1d-47c8-a9dd-603349b998bd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:04.712234 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9ec990-ad1d-47c8-a9dd-603349b998bd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:04.712711 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9ec990-ad1d-47c8-a9dd-603349b998bd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:04.713690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9ec990-ad1d-47c8-a9dd-603349b998bd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:04.714164 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9ec990-ad1d-47c8-a9dd-603349b998bd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:04.714588 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de9ec990-ad1d-47c8-a9dd-603349b998bd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:04.899360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-de9ec990-ad1d-47c8-a9dd-603349b998bd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:04.907859 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-de9ec990-ad1d-47c8-a9dd-603349b998bd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1319 microversion: 2.1 time: 0.207228 Sep 08 13:56:04.908450 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 237/481] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:04 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:05.730534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4941a569-a9e0-457f-8ac9-56e9348de5e8 req-b7fbb4fc-a6fd-47fd-bae7-faf7729e8b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a3e9d6-2e31-4f70-ae65-a40552851588", "tag": "b9784d38-d516-4bbc-af3e-459cad3ad635"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:05.740735 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4941a569-a9e0-457f-8ac9-56e9348de5e8 req-b7fbb4fc-a6fd-47fd-bae7-faf7729e8b74 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:05.741209 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4941a569-a9e0-457f-8ac9-56e9348de5e8 req-b7fbb4fc-a6fd-47fd-bae7-faf7729e8b74 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:05.741644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4941a569-a9e0-457f-8ac9-56e9348de5e8 req-b7fbb4fc-a6fd-47fd-bae7-faf7729e8b74 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:05.755907 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-4941a569-a9e0-457f-8ac9-56e9348de5e8 req-b7fbb4fc-a6fd-47fd-bae7-faf7729e8b74 service nova] Creating event network-changed:b9784d38-d516-4bbc-af3e-459cad3ad635 for instance a3a3e9d6-2e31-4f70-ae65-a40552851588 on hv-cinder-82002 Sep 08 13:56:05.761996 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4941a569-a9e0-457f-8ac9-56e9348de5e8 req-b7fbb4fc-a6fd-47fd-bae7-faf7729e8b74 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035141 Sep 08 13:56:05.763114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 245/482] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:05.932816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-957dadc8-0060-4a5a-9913-b16381c85779 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:05.933432 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-957dadc8-0060-4a5a-9913-b16381c85779 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:05.939987 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-957dadc8-0060-4a5a-9913-b16381c85779 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:05.940474 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-957dadc8-0060-4a5a-9913-b16381c85779 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:05.940909 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-957dadc8-0060-4a5a-9913-b16381c85779 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:05.941606 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-957dadc8-0060-4a5a-9913-b16381c85779 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:05.942143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-957dadc8-0060-4a5a-9913-b16381c85779 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:05.942634 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-957dadc8-0060-4a5a-9913-b16381c85779 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:06.161579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-957dadc8-0060-4a5a-9913-b16381c85779 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:06.169281 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-957dadc8-0060-4a5a-9913-b16381c85779 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1319 microversion: 2.1 time: 0.240827 Sep 08 13:56:06.169875 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 238/483] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:05 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:07.193911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd60649c-e08a-4f4e-856f-2fbddb31fe2e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:07.194545 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fd60649c-e08a-4f4e-856f-2fbddb31fe2e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:07.200582 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd60649c-e08a-4f4e-856f-2fbddb31fe2e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:07.201049 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd60649c-e08a-4f4e-856f-2fbddb31fe2e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:07.201474 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd60649c-e08a-4f4e-856f-2fbddb31fe2e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:07.202223 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd60649c-e08a-4f4e-856f-2fbddb31fe2e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:07.203174 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd60649c-e08a-4f4e-856f-2fbddb31fe2e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:07.203585 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd60649c-e08a-4f4e-856f-2fbddb31fe2e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:07.330892 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-fd60649c-e08a-4f4e-856f-2fbddb31fe2e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:07.338764 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd60649c-e08a-4f4e-856f-2fbddb31fe2e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1319 microversion: 2.1 time: 0.149366 Sep 08 13:56:07.339322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 246/484] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:07 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:08.361789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-36ed2f88-2f2c-4b40-81b5-4492d38b8f6e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:08.362325 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-36ed2f88-2f2c-4b40-81b5-4492d38b8f6e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:08.369040 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36ed2f88-2f2c-4b40-81b5-4492d38b8f6e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:08.369515 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36ed2f88-2f2c-4b40-81b5-4492d38b8f6e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:08.369980 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36ed2f88-2f2c-4b40-81b5-4492d38b8f6e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:08.370669 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36ed2f88-2f2c-4b40-81b5-4492d38b8f6e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:08.371119 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36ed2f88-2f2c-4b40-81b5-4492d38b8f6e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:08.371544 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36ed2f88-2f2c-4b40-81b5-4492d38b8f6e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:08.502584 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-36ed2f88-2f2c-4b40-81b5-4492d38b8f6e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:08.510024 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-36ed2f88-2f2c-4b40-81b5-4492d38b8f6e tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1319 microversion: 2.1 time: 0.152668 Sep 08 13:56:08.510583 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 239/485] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:08 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:09.532484 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-93c76bfb-4cb3-48f5-aaa9-cc1200d50169 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:09.533101 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-93c76bfb-4cb3-48f5-aaa9-cc1200d50169 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:09.539480 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93c76bfb-4cb3-48f5-aaa9-cc1200d50169 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:09.539965 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93c76bfb-4cb3-48f5-aaa9-cc1200d50169 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:09.540398 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93c76bfb-4cb3-48f5-aaa9-cc1200d50169 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:09.541086 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93c76bfb-4cb3-48f5-aaa9-cc1200d50169 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:09.541538 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93c76bfb-4cb3-48f5-aaa9-cc1200d50169 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:09.541980 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93c76bfb-4cb3-48f5-aaa9-cc1200d50169 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:09.669394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-93c76bfb-4cb3-48f5-aaa9-cc1200d50169 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:09.677447 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-93c76bfb-4cb3-48f5-aaa9-cc1200d50169 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1319 microversion: 2.1 time: 0.148836 Sep 08 13:56:09.678061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 247/486] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:09 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:10.700384 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-272fbe54-e268-4268-b22d-601366d779dd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:10.701012 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-272fbe54-e268-4268-b22d-601366d779dd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:10.707908 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-272fbe54-e268-4268-b22d-601366d779dd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:10.708381 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-272fbe54-e268-4268-b22d-601366d779dd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:10.708805 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-272fbe54-e268-4268-b22d-601366d779dd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:10.709488 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-272fbe54-e268-4268-b22d-601366d779dd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:10.709962 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-272fbe54-e268-4268-b22d-601366d779dd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:10.710388 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-272fbe54-e268-4268-b22d-601366d779dd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:10.850867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-272fbe54-e268-4268-b22d-601366d779dd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:10.858373 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-272fbe54-e268-4268-b22d-601366d779dd tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1319 microversion: 2.1 time: 0.161813 Sep 08 13:56:10.858939 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 240/487] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:10 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:11.261202 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3b0e5349-5547-4b33-ac9a-ab34ce4902e7 req-600f743f-e6c8-4dfb-867c-6ac85aa14b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a3e9d6-2e31-4f70-ae65-a40552851588", "name": "network-vif-plugged", "status": "completed", "tag": "b9784d38-d516-4bbc-af3e-459cad3ad635"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:11.273874 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3b0e5349-5547-4b33-ac9a-ab34ce4902e7 req-600f743f-e6c8-4dfb-867c-6ac85aa14b08 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:11.274355 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3b0e5349-5547-4b33-ac9a-ab34ce4902e7 req-600f743f-e6c8-4dfb-867c-6ac85aa14b08 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:11.274784 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3b0e5349-5547-4b33-ac9a-ab34ce4902e7 req-600f743f-e6c8-4dfb-867c-6ac85aa14b08 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:11.285780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3b0e5349-5547-4b33-ac9a-ab34ce4902e7 req-600f743f-e6c8-4dfb-867c-6ac85aa14b08 service nova] Creating event network-vif-plugged:b9784d38-d516-4bbc-af3e-459cad3ad635 for instance a3a3e9d6-2e31-4f70-ae65-a40552851588 on hv-cinder-82002 Sep 08 13:56:11.290788 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3b0e5349-5547-4b33-ac9a-ab34ce4902e7 req-600f743f-e6c8-4dfb-867c-6ac85aa14b08 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033415 Sep 08 13:56:11.291372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 248/488] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:11.880372 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1fe8a4e8-9066-40cf-8d1d-62a160476c2d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:11.880983 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1fe8a4e8-9066-40cf-8d1d-62a160476c2d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:11.887820 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fe8a4e8-9066-40cf-8d1d-62a160476c2d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:11.888295 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fe8a4e8-9066-40cf-8d1d-62a160476c2d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:11.888721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fe8a4e8-9066-40cf-8d1d-62a160476c2d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:11.889936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fe8a4e8-9066-40cf-8d1d-62a160476c2d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:11.890376 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fe8a4e8-9066-40cf-8d1d-62a160476c2d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:11.890799 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fe8a4e8-9066-40cf-8d1d-62a160476c2d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:12.019151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1fe8a4e8-9066-40cf-8d1d-62a160476c2d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:12.026764 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1fe8a4e8-9066-40cf-8d1d-62a160476c2d tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1319 microversion: 2.1 time: 0.150223 Sep 08 13:56:12.027315 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 241/489] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:11 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:13.051159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2ffb4db8-b105-4510-80a0-251f5bbc8a6b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:13.051859 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2ffb4db8-b105-4510-80a0-251f5bbc8a6b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:13.053817 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:13.054480 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:13.060732 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ffb4db8-b105-4510-80a0-251f5bbc8a6b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:13.061245 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ffb4db8-b105-4510-80a0-251f5bbc8a6b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:13.061679 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ffb4db8-b105-4510-80a0-251f5bbc8a6b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:13.062403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ffb4db8-b105-4510-80a0-251f5bbc8a6b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:13.062904 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ffb4db8-b105-4510-80a0-251f5bbc8a6b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:13.063285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ffb4db8-b105-4510-80a0-251f5bbc8a6b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:13.198382 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2ffb4db8-b105-4510-80a0-251f5bbc8a6b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:13.206151 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2ffb4db8-b105-4510-80a0-251f5bbc8a6b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1319 microversion: 2.1 time: 0.159151 Sep 08 13:56:13.206711 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 249/490] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:13 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:14.229294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-331f5d31-f1ea-437d-8a70-94635c5d8a36 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:14.229856 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-331f5d31-f1ea-437d-8a70-94635c5d8a36 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:14.231715 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:14.237927 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-331f5d31-f1ea-437d-8a70-94635c5d8a36 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:14.238414 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-331f5d31-f1ea-437d-8a70-94635c5d8a36 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:14.238846 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-331f5d31-f1ea-437d-8a70-94635c5d8a36 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:14.239534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-331f5d31-f1ea-437d-8a70-94635c5d8a36 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:14.239985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-331f5d31-f1ea-437d-8a70-94635c5d8a36 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:14.240405 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-331f5d31-f1ea-437d-8a70-94635c5d8a36 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:14.366992 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-331f5d31-f1ea-437d-8a70-94635c5d8a36 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:14.375278 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-331f5d31-f1ea-437d-8a70-94635c5d8a36 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1509 microversion: 2.1 time: 0.149477 Sep 08 13:56:14.375840 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 242/491] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:14 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:14.397218 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2aa7820c-f548-42d3-909f-4415b3ae4c66 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2d84fcc-8335-4249-bd84-dfe19ea9f9af", "device": "/dev/sdb"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:14.400198 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2aa7820c-f548-42d3-909f-4415b3ae4c66 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:14.406546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa7820c-f548-42d3-909f-4415b3ae4c66 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:14.407021 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa7820c-f548-42d3-909f-4415b3ae4c66 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:14.407450 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa7820c-f548-42d3-909f-4415b3ae4c66 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:14.408133 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa7820c-f548-42d3-909f-4415b3ae4c66 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:14.408585 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa7820c-f548-42d3-909f-4415b3ae4c66 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:14.409006 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2aa7820c-f548-42d3-909f-4415b3ae4c66 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:14.815300 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2aa7820c-f548-42d3-909f-4415b3ae4c66 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "POST /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421916 Sep 08 13:56:14.815899 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 250/492] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 13:56:14 2022] POST /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:19.962264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-20b62305-2319-48d3-8383-f06971b986d8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:19.962756 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-20b62305-2319-48d3-8383-f06971b986d8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:19.970028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b62305-2319-48d3-8383-f06971b986d8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:19.970508 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b62305-2319-48d3-8383-f06971b986d8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:19.970941 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b62305-2319-48d3-8383-f06971b986d8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:19.971657 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b62305-2319-48d3-8383-f06971b986d8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:19.972104 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b62305-2319-48d3-8383-f06971b986d8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:19.972524 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b62305-2319-48d3-8383-f06971b986d8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:19.997476 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-20b62305-2319-48d3-8383-f06971b986d8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/ips" status: 200 len: 151 microversion: 2.20 time: 0.039030 Sep 08 13:56:19.998063 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 243/493] 10.222.0.55 () {60 vars in 1289 bytes} [Thu Sep 8 13:56:19 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:56:21.080598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d6175d9c-ae51-4a1a-8d04-7feda2be6ad4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:21.083033 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d6175d9c-ae51-4a1a-8d04-7feda2be6ad4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:21.089874 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6175d9c-ae51-4a1a-8d04-7feda2be6ad4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:21.090346 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6175d9c-ae51-4a1a-8d04-7feda2be6ad4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:21.090780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6175d9c-ae51-4a1a-8d04-7feda2be6ad4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:21.091469 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6175d9c-ae51-4a1a-8d04-7feda2be6ad4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:21.091923 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6175d9c-ae51-4a1a-8d04-7feda2be6ad4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:21.092901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6175d9c-ae51-4a1a-8d04-7feda2be6ad4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:21.169156 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d6175d9c-ae51-4a1a-8d04-7feda2be6ad4 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "POST /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/action" status: 202 len: 0 microversion: 2.1 time: 0.093172 Sep 08 13:56:21.170291 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 251/494] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:56:21 2022] POST /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:56:21.178573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-35dbe6b3-0574-4eae-b440-0c3d4d32a2b2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:21.179187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-35dbe6b3-0574-4eae-b440-0c3d4d32a2b2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:21.185725 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dbe6b3-0574-4eae-b440-0c3d4d32a2b2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:21.186266 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dbe6b3-0574-4eae-b440-0c3d4d32a2b2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:21.186697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dbe6b3-0574-4eae-b440-0c3d4d32a2b2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:21.187391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dbe6b3-0574-4eae-b440-0c3d4d32a2b2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:21.187843 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dbe6b3-0574-4eae-b440-0c3d4d32a2b2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:21.188260 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-35dbe6b3-0574-4eae-b440-0c3d4d32a2b2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:21.339472 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-35dbe6b3-0574-4eae-b440-0c3d4d32a2b2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:21.348019 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-35dbe6b3-0574-4eae-b440-0c3d4d32a2b2 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1751 microversion: 2.1 time: 0.173358 Sep 08 13:56:21.348667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 244/495] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:21 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:22.372590 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f7ee18e6-40ba-4322-bf6d-ca44e332c4cf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:22.373339 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f7ee18e6-40ba-4322-bf6d-ca44e332c4cf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:22.380611 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ee18e6-40ba-4322-bf6d-ca44e332c4cf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:22.381087 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ee18e6-40ba-4322-bf6d-ca44e332c4cf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:22.381512 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ee18e6-40ba-4322-bf6d-ca44e332c4cf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:22.382228 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ee18e6-40ba-4322-bf6d-ca44e332c4cf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:22.382709 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ee18e6-40ba-4322-bf6d-ca44e332c4cf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:22.383126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f7ee18e6-40ba-4322-bf6d-ca44e332c4cf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:22.528468 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f7ee18e6-40ba-4322-bf6d-ca44e332c4cf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:22.537350 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f7ee18e6-40ba-4322-bf6d-ca44e332c4cf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1751 microversion: 2.1 time: 0.168856 Sep 08 13:56:22.537973 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 252/496] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:22 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:23.289067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d32bf5b0-52dc-4a03-888f-2ff872df6195 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:23.289655 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d32bf5b0-52dc-4a03-888f-2ff872df6195 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:23.296798 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32bf5b0-52dc-4a03-888f-2ff872df6195 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:23.297289 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32bf5b0-52dc-4a03-888f-2ff872df6195 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:23.297725 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32bf5b0-52dc-4a03-888f-2ff872df6195 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:23.298449 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32bf5b0-52dc-4a03-888f-2ff872df6195 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:23.298901 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32bf5b0-52dc-4a03-888f-2ff872df6195 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:23.299357 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d32bf5b0-52dc-4a03-888f-2ff872df6195 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:23.323668 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-d32bf5b0-52dc-4a03-888f-2ff872df6195 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lazy-loading 'flavor' on Instance uuid efdb4c65-ed8d-4792-ac96-8b1053b167b5 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:56:23.520645 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d32bf5b0-52dc-4a03-888f-2ff872df6195 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "POST /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/action" status: 202 len: 0 microversion: 2.20 time: 0.235528 Sep 08 13:56:23.521682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 245/497] 10.222.0.55 () {62 vars in 1319 bytes} [Thu Sep 8 13:56:23 2022] POST /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:56:23.533322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:23.534553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:23.546840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:23.547595 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:23.548231 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:23.549286 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:23.549865 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:23.550464 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:23.562032 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-61e7ba68-e18b-410a-bddd-a7e5fe3f2956 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:23.562823 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-61e7ba68-e18b-410a-bddd-a7e5fe3f2956 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:23.569350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e7ba68-e18b-410a-bddd-a7e5fe3f2956 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:23.569987 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e7ba68-e18b-410a-bddd-a7e5fe3f2956 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:23.570476 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e7ba68-e18b-410a-bddd-a7e5fe3f2956 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:23.571266 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e7ba68-e18b-410a-bddd-a7e5fe3f2956 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:23.571774 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e7ba68-e18b-410a-bddd-a7e5fe3f2956 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:23.572258 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61e7ba68-e18b-410a-bddd-a7e5fe3f2956 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:23.776918 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:23.785122 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:23.785916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-61e7ba68-e18b-410a-bddd-a7e5fe3f2956 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:23.786591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:23.787766 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2b4a89b7-6f64-4179-b0cb-d66d466cb5a6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.261335 Sep 08 13:56:23.788326 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 253/498] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:23 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:23.794506 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-61e7ba68-e18b-410a-bddd-a7e5fe3f2956 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1751 microversion: 2.1 time: 0.237720 Sep 08 13:56:23.795064 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 246/499] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:23 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1751 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:24.814264 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:24.814782 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:24.817703 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fd9def5a-6adf-4e4f-9ff9-60d6498dcd7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:24.818338 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fd9def5a-6adf-4e4f-9ff9-60d6498dcd7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:24.821819 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:24.821959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:24.822333 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:24.823025 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:24.823479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:24.823899 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:24.824687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd9def5a-6adf-4e4f-9ff9-60d6498dcd7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:24.825167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd9def5a-6adf-4e4f-9ff9-60d6498dcd7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:24.825601 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd9def5a-6adf-4e4f-9ff9-60d6498dcd7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:24.826312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd9def5a-6adf-4e4f-9ff9-60d6498dcd7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:24.827357 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd9def5a-6adf-4e4f-9ff9-60d6498dcd7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:24.827782 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fd9def5a-6adf-4e4f-9ff9-60d6498dcd7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:25.015477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:25.024061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:25.025561 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:25.026741 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-169e6822-809f-4793-b28b-bb21baff5b92 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.216987 Sep 08 13:56:25.027301 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 254/500] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:24 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:25.035324 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-fd9def5a-6adf-4e4f-9ff9-60d6498dcd7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:25.044330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fd9def5a-6adf-4e4f-9ff9-60d6498dcd7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.230414 Sep 08 13:56:25.044895 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 247/501] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:24 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:26.052855 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:26.053459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:26.060083 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:26.060567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:26.061046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:26.061752 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:26.062221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:26.063185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:26.068744 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8b7d518-2070-49ba-b0d2-bc3f45151c51 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:26.069448 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f8b7d518-2070-49ba-b0d2-bc3f45151c51 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:26.075803 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8b7d518-2070-49ba-b0d2-bc3f45151c51 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:26.076279 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8b7d518-2070-49ba-b0d2-bc3f45151c51 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:26.076779 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8b7d518-2070-49ba-b0d2-bc3f45151c51 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:26.077465 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8b7d518-2070-49ba-b0d2-bc3f45151c51 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:26.077936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8b7d518-2070-49ba-b0d2-bc3f45151c51 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:26.078356 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8b7d518-2070-49ba-b0d2-bc3f45151c51 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:26.245870 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:26.254286 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:26.255706 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:26.256843 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2b2dd25f-fdad-4369-b7ea-9aaafbc5f8e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.207889 Sep 08 13:56:26.257398 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 255/502] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:26 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:26.281373 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f8b7d518-2070-49ba-b0d2-bc3f45151c51 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:26.289435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f8b7d518-2070-49ba-b0d2-bc3f45151c51 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.224545 Sep 08 13:56:26.290022 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 248/503] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:26 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:27.282580 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:27.283164 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:27.289581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:27.290088 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:27.290522 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:27.291206 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:27.291657 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:27.292080 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:27.313345 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed1c5edc-c80d-4195-8400-ba9da7c7bd47 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:27.314563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed1c5edc-c80d-4195-8400-ba9da7c7bd47 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:27.321105 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed1c5edc-c80d-4195-8400-ba9da7c7bd47 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:27.321587 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed1c5edc-c80d-4195-8400-ba9da7c7bd47 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:27.322054 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed1c5edc-c80d-4195-8400-ba9da7c7bd47 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:27.322754 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed1c5edc-c80d-4195-8400-ba9da7c7bd47 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:27.323205 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed1c5edc-c80d-4195-8400-ba9da7c7bd47 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:27.323625 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed1c5edc-c80d-4195-8400-ba9da7c7bd47 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:27.487069 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:27.495411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:27.496841 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:27.498015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d903b0c5-6752-4b0a-bac5-0ac1f028d096 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.219402 Sep 08 13:56:27.499154 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 256/504] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:27 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:27.514008 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed1c5edc-c80d-4195-8400-ba9da7c7bd47 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:27.522675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed1c5edc-c80d-4195-8400-ba9da7c7bd47 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.213679 Sep 08 13:56:27.523311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 249/505] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:27 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:28.524350 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:28.524952 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:28.531382 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:28.531855 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:28.532276 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:28.532945 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:28.533386 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:28.533884 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:28.545854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9011c91a-780e-4cbd-a569-82221d2c37f9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:28.546472 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9011c91a-780e-4cbd-a569-82221d2c37f9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:28.552699 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9011c91a-780e-4cbd-a569-82221d2c37f9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:28.553177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9011c91a-780e-4cbd-a569-82221d2c37f9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:28.553611 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9011c91a-780e-4cbd-a569-82221d2c37f9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:28.554364 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9011c91a-780e-4cbd-a569-82221d2c37f9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:28.554818 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9011c91a-780e-4cbd-a569-82221d2c37f9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:28.555238 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9011c91a-780e-4cbd-a569-82221d2c37f9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:28.726116 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:28.735647 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:28.737230 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:28.738420 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2e799a03-eb9a-4e72-9851-80a976814e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.218523 Sep 08 13:56:28.738982 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 257/506] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:28 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:28.761557 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9011c91a-780e-4cbd-a569-82221d2c37f9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:28.770436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9011c91a-780e-4cbd-a569-82221d2c37f9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.228469 Sep 08 13:56:28.770995 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 250/507] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:28 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:29.764706 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:29.765223 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:29.771632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:29.772858 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:29.773296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:29.773999 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:29.774444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:29.774855 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:29.794393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-20b5a8ad-9607-46af-a6d1-d038a9626be7 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:29.795008 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-20b5a8ad-9607-46af-a6d1-d038a9626be7 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:29.801030 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b5a8ad-9607-46af-a6d1-d038a9626be7 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:29.801509 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b5a8ad-9607-46af-a6d1-d038a9626be7 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:29.801967 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b5a8ad-9607-46af-a6d1-d038a9626be7 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:29.802666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b5a8ad-9607-46af-a6d1-d038a9626be7 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:29.803114 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b5a8ad-9607-46af-a6d1-d038a9626be7 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:29.803540 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-20b5a8ad-9607-46af-a6d1-d038a9626be7 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:29.974030 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:29.982146 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:29.984076 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:29.985230 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e59f8a92-eb7f-4a75-954b-d2057d755e8d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.224978 Sep 08 13:56:29.985797 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 258/508] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:29 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:29.994180 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-20b5a8ad-9607-46af-a6d1-d038a9626be7 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:29.997588 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:30.003461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-20b5a8ad-9607-46af-a6d1-d038a9626be7 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.212892 Sep 08 13:56:30.004020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 251/509] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:29 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:31.011015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:31.011627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:31.014512 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:31.019743 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:31.020236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:31.020666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:31.021357 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:31.021839 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:31.022261 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:31.027714 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-858a7e88-5132-474a-af08-921fe780ec37 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:31.028203 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:31.028310 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-858a7e88-5132-474a-af08-921fe780ec37 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:31.035171 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858a7e88-5132-474a-af08-921fe780ec37 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:31.035660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858a7e88-5132-474a-af08-921fe780ec37 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:31.036123 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858a7e88-5132-474a-af08-921fe780ec37 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:31.036826 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858a7e88-5132-474a-af08-921fe780ec37 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:31.037279 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858a7e88-5132-474a-af08-921fe780ec37 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:31.037704 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-858a7e88-5132-474a-af08-921fe780ec37 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:31.205841 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:31.214209 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:31.215667 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:31.216885 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f6f00fe9-58fb-4492-b649-32870f75c4f9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.209709 Sep 08 13:56:31.217449 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 259/510] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:31 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:31.240143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-858a7e88-5132-474a-af08-921fe780ec37 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:31.248721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-858a7e88-5132-474a-af08-921fe780ec37 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.225437 Sep 08 13:56:31.249278 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 252/511] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:31 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:32.242230 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:32.242789 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:32.249976 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:32.250454 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:32.250910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:32.251596 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:32.252043 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:32.252459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:32.272363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d44ecbe-fdb8-4c74-aa4e-41e1e5708c7b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:32.272980 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0d44ecbe-fdb8-4c74-aa4e-41e1e5708c7b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:32.279339 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d44ecbe-fdb8-4c74-aa4e-41e1e5708c7b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:32.279823 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d44ecbe-fdb8-4c74-aa4e-41e1e5708c7b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:32.280264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d44ecbe-fdb8-4c74-aa4e-41e1e5708c7b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:32.280959 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d44ecbe-fdb8-4c74-aa4e-41e1e5708c7b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:32.281412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d44ecbe-fdb8-4c74-aa4e-41e1e5708c7b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:32.281868 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d44ecbe-fdb8-4c74-aa4e-41e1e5708c7b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:32.449455 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:32.457608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:32.459138 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:32.460288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0acd63c2-939c-447d-92bb-50faa5e86af5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.222020 Sep 08 13:56:32.460840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 260/512] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:32 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:32.464968 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d44ecbe-fdb8-4c74-aa4e-41e1e5708c7b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:32.473061 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d44ecbe-fdb8-4c74-aa4e-41e1e5708c7b tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.204584 Sep 08 13:56:32.473617 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 253/513] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:32 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:33.487068 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:33.487805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:33.494684 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:33.495188 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:33.495624 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:33.496328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:33.496559 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c9032559-89ee-4433-bddb-e1046253ef44 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:33.496985 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:33.497166 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c9032559-89ee-4433-bddb-e1046253ef44 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:33.497283 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:33.499495 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=39 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:33.505207 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9032559-89ee-4433-bddb-e1046253ef44 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:33.505709 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9032559-89ee-4433-bddb-e1046253ef44 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:33.506287 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9032559-89ee-4433-bddb-e1046253ef44 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:33.507067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9032559-89ee-4433-bddb-e1046253ef44 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:33.507617 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9032559-89ee-4433-bddb-e1046253ef44 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:33.508088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c9032559-89ee-4433-bddb-e1046253ef44 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:33.694117 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:33.702778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:33.704220 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:33.705368 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-36ed7b8d-f190-4773-9090-8397d1591e57 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.222975 Sep 08 13:56:33.705951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 261/514] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:33 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:33.714638 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c9032559-89ee-4433-bddb-e1046253ef44 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:33.722782 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c9032559-89ee-4433-bddb-e1046253ef44 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.230330 Sep 08 13:56:33.723338 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 254/515] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:33 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:34.730411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:34.731014 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:34.737274 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:34.737761 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:34.738194 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:34.738867 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:34.739312 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:34.739719 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:34.746303 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b161e27b-8930-4817-bd6b-394b23e91a2a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:34.746915 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b161e27b-8930-4817-bd6b-394b23e91a2a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:34.752754 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b161e27b-8930-4817-bd6b-394b23e91a2a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:34.753230 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b161e27b-8930-4817-bd6b-394b23e91a2a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:34.753660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b161e27b-8930-4817-bd6b-394b23e91a2a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:34.754419 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b161e27b-8930-4817-bd6b-394b23e91a2a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:34.754899 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b161e27b-8930-4817-bd6b-394b23e91a2a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:34.755322 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b161e27b-8930-4817-bd6b-394b23e91a2a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:34.940752 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:34.948677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:34.950126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:34.951264 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65e2a07b-df5e-48b1-b034-5c391931e820 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.224748 Sep 08 13:56:34.951819 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 262/516] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:34 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:34.956265 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b161e27b-8930-4817-bd6b-394b23e91a2a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:34.964724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b161e27b-8930-4817-bd6b-394b23e91a2a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.222414 Sep 08 13:56:34.965280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 255/517] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:34 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:35.977835 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:35.978472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:35.984894 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:35.985372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:35.985829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:35.986557 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:35.986999 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:35.987422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:35.987867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4f003d18-3bf7-43e4-968a-0170ab626a67 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:35.988548 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4f003d18-3bf7-43e4-968a-0170ab626a67 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:35.995000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f003d18-3bf7-43e4-968a-0170ab626a67 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:35.995426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f003d18-3bf7-43e4-968a-0170ab626a67 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:35.995856 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f003d18-3bf7-43e4-968a-0170ab626a67 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:35.996555 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f003d18-3bf7-43e4-968a-0170ab626a67 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:35.997005 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f003d18-3bf7-43e4-968a-0170ab626a67 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:35.997425 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f003d18-3bf7-43e4-968a-0170ab626a67 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:36.185098 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:36.193366 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:36.194846 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:36.196007 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-266e0b19-8f35-49d0-b6fd-0d16f92431cd tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.222135 Sep 08 13:56:36.196563 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 263/518] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:35 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:36.204190 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4f003d18-3bf7-43e4-968a-0170ab626a67 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:36.213146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4f003d18-3bf7-43e4-968a-0170ab626a67 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.229096 Sep 08 13:56:36.214073 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 256/519] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:35 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:36.302035 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-009e61c2-0409-4bf8-9464-629a7356ffe5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:36.302561 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-009e61c2-0409-4bf8-9464-629a7356ffe5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:36.308437 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-009e61c2-0409-4bf8-9464-629a7356ffe5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:36.308916 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-009e61c2-0409-4bf8-9464-629a7356ffe5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:36.309347 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-009e61c2-0409-4bf8-9464-629a7356ffe5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:36.310056 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-009e61c2-0409-4bf8-9464-629a7356ffe5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:36.311000 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-009e61c2-0409-4bf8-9464-629a7356ffe5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:36.311416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-009e61c2-0409-4bf8-9464-629a7356ffe5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:36.392461 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-009e61c2-0409-4bf8-9464-629a7356ffe5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lazy-loading 'services' on Instance uuid a3a3e9d6-2e31-4f70-ae65-a40552851588 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:56:36.465453 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-009e61c2-0409-4bf8-9464-629a7356ffe5 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588/os-volume_attachments/d2d84fcc-8335-4249-bd84-dfe19ea9f9af" status: 202 len: 0 microversion: 2.1 time: 0.167105 Sep 08 13:56:36.466094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 264/520] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 13:56:36 2022] DELETE /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588/os-volume_attachments/d2d84fcc-8335-4249-bd84-dfe19ea9f9af => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:56:37.227261 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:37.227927 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:37.234911 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:37.235401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:37.235837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:37.236540 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:37.236994 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:37.237417 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:37.238431 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b31b6814-d3b3-404d-8908-d26896564f1e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:37.239147 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b31b6814-d3b3-404d-8908-d26896564f1e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:37.245308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b31b6814-d3b3-404d-8908-d26896564f1e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:37.245808 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b31b6814-d3b3-404d-8908-d26896564f1e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:37.246245 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b31b6814-d3b3-404d-8908-d26896564f1e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:37.246935 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b31b6814-d3b3-404d-8908-d26896564f1e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:37.247429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b31b6814-d3b3-404d-8908-d26896564f1e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:37.247840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b31b6814-d3b3-404d-8908-d26896564f1e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:37.706873 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:37.715143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:37.716593 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:37.717822 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-31b5f6c5-8007-4015-abf0-f69a5eac7d43 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.495438 Sep 08 13:56:37.718387 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 257/521] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:37 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:37.722246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b31b6814-d3b3-404d-8908-d26896564f1e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:37.730399 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b31b6814-d3b3-404d-8908-d26896564f1e tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.496756 Sep 08 13:56:37.730944 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 265/522] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:37 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:37.894484 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-83cf7c37-acff-4f4b-875c-8cf67e5d5047 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:37.895288 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-83cf7c37-acff-4f4b-875c-8cf67e5d5047 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:37.913451 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf7c37-acff-4f4b-875c-8cf67e5d5047 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:37.913978 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf7c37-acff-4f4b-875c-8cf67e5d5047 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:37.914413 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf7c37-acff-4f4b-875c-8cf67e5d5047 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:37.915127 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf7c37-acff-4f4b-875c-8cf67e5d5047 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:37.915579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf7c37-acff-4f4b-875c-8cf67e5d5047 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:37.916006 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-83cf7c37-acff-4f4b-875c-8cf67e5d5047 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:37.939892 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-83cf7c37-acff-4f4b-875c-8cf67e5d5047 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32/ips" status: 200 len: 151 microversion: 2.1 time: 0.052835 Sep 08 13:56:37.940593 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 258/523] 10.222.0.55 () {58 vars in 1248 bytes} [Thu Sep 8 13:56:37 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:37.952226 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab642d3d-1712-4435-a8e6-3ab0eb1375c2"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:37.955062 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:37.961396 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:37.962113 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:37.962824 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:37.963937 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:37.964560 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:37.965144 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.073115 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Invalid volume: volume ab642d3d-1712-4435-a8e6-3ab0eb1375c2 is already attached to instances: c6a4b8e4-4292-4db0-89b6-b09f84f513ce Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32/os-volume_attachments HTTP/1.1 Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 74 Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:56:38.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {"volumeAttachment": {"volumeId": "ab642d3d-1712-4435-a8e6-3ab0eb1375c2"}} Sep 08 13:56:38.076959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Invalid volume: volume ab642d3d-1712-4435-a8e6-3ab0eb1375c2 is already attached to instances: c6a4b8e4-4292-4db0-89b6-b09f84f513ce Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'server_id': '959f81c9-4c88-41e0-8eb9-e5b3fb5faa32', 'body': {'volumeAttachment': {'volumeId': 'ab642d3d-1712-4435-a8e6-3ab0eb1375c2'}}} Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ab642d3d-1712-4435-a8e6-3ab0eb1375c2 is already attached to instances: c6a4b8e4-4292-4db0-89b6-b09f84f513ce Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:56:38.077951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ab642d3d-1712-4435-a8e6-3ab0eb1375c2 is already attached to instances: c6a4b8e4-4292-4db0-89b6-b09f84f513ce Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:38.079384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:38.080812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:38.080812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:56:38.080812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:56:38.080812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ab642d3d-1712-4435-a8e6-3ab0eb1375c2 is already attached to instances: c6a4b8e4-4292-4db0-89b6-b09f84f513ce Sep 08 13:56:38.080812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:56:38.082360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 400 to user: Invalid volume: volume ab642d3d-1712-4435-a8e6-3ab0eb1375c2 is already attached to instances: c6a4b8e4-4292-4db0-89b6-b09f84f513ce {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:56:38.083222 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4c7e70cb-564c-400a-be24-2b5884a5a812 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134992 Sep 08 13:56:38.083807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 266/524] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 13:56:37 2022] POST /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 13:56:38.093399 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ab45847-895c-4c74-8ef0-7bcdf592d7c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:38.093926 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ab45847-895c-4c74-8ef0-7bcdf592d7c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:38.099919 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ab45847-895c-4c74-8ef0-7bcdf592d7c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.100398 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ab45847-895c-4c74-8ef0-7bcdf592d7c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.100834 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ab45847-895c-4c74-8ef0-7bcdf592d7c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.101589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ab45847-895c-4c74-8ef0-7bcdf592d7c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.102072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ab45847-895c-4c74-8ef0-7bcdf592d7c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.102494 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ab45847-895c-4c74-8ef0-7bcdf592d7c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.127452 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ab45847-895c-4c74-8ef0-7bcdf592d7c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:56:38.205089 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ab45847-895c-4c74-8ef0-7bcdf592d7c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 204 len: 0 microversion: 2.1 time: 0.115781 Sep 08 13:56:38.205683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 259/525] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:56:38 2022] DELETE /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:56:38.214528 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5d229be3-1074-445f-8f23-6265e235d874 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:38.215404 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5d229be3-1074-445f-8f23-6265e235d874 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:38.223682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d229be3-1074-445f-8f23-6265e235d874 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.224173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d229be3-1074-445f-8f23-6265e235d874 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.224608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d229be3-1074-445f-8f23-6265e235d874 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.225340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d229be3-1074-445f-8f23-6265e235d874 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.225815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d229be3-1074-445f-8f23-6265e235d874 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.226236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d229be3-1074-445f-8f23-6265e235d874 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.352015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5d229be3-1074-445f-8f23-6265e235d874 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:38.359594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5d229be3-1074-445f-8f23-6265e235d874 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1683 microversion: 2.1 time: 0.149671 Sep 08 13:56:38.360149 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 267/526] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:38 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:38.655774 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-13b3b169-1274-4389-adf0-ce506b7b1394 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:38.656387 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-13b3b169-1274-4389-adf0-ce506b7b1394 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:38.662783 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13b3b169-1274-4389-adf0-ce506b7b1394 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.663257 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13b3b169-1274-4389-adf0-ce506b7b1394 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.663688 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13b3b169-1274-4389-adf0-ce506b7b1394 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.664369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13b3b169-1274-4389-adf0-ce506b7b1394 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.664824 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13b3b169-1274-4389-adf0-ce506b7b1394 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.665241 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13b3b169-1274-4389-adf0-ce506b7b1394 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.690069 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-13b3b169-1274-4389-adf0-ce506b7b1394 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:56:38.744106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:38.744807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:38.751336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.751808 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.752282 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.752963 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.753404 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.753841 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.765102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-13b3b169-1274-4389-adf0-ce506b7b1394 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 204 len: 0 microversion: 2.1 time: 0.113219 Sep 08 13:56:38.765692 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 260/527] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:56:38 2022] DELETE /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:56:38.770899 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ce01ab63-7d18-4a18-b433-df8efd65429c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:38.771593 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ce01ab63-7d18-4a18-b433-df8efd65429c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:38.777172 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce01ab63-7d18-4a18-b433-df8efd65429c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.777675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce01ab63-7d18-4a18-b433-df8efd65429c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.778142 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce01ab63-7d18-4a18-b433-df8efd65429c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.778873 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce01ab63-7d18-4a18-b433-df8efd65429c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.779329 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce01ab63-7d18-4a18-b433-df8efd65429c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.779730 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce01ab63-7d18-4a18-b433-df8efd65429c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.950284 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:38.958897 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:38.960321 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:38.961459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c91629eb-c18a-49e6-9fb5-2fee5b6e3cba tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.221354 Sep 08 13:56:38.962032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 268/528] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:38 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:38.966594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-93db6816-a8a8-4330-a607-e79a8a47b07f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:38.967163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-93db6816-a8a8-4330-a607-e79a8a47b07f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:38.972903 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93db6816-a8a8-4330-a607-e79a8a47b07f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.973616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93db6816-a8a8-4330-a607-e79a8a47b07f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.974088 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93db6816-a8a8-4330-a607-e79a8a47b07f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.974774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93db6816-a8a8-4330-a607-e79a8a47b07f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:38.975216 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93db6816-a8a8-4330-a607-e79a8a47b07f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:38.975628 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-93db6816-a8a8-4330-a607-e79a8a47b07f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:38.979522 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ce01ab63-7d18-4a18-b433-df8efd65429c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:38.988210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ce01ab63-7d18-4a18-b433-df8efd65429c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.221385 Sep 08 13:56:38.988776 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 261/529] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:38 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:39.104073 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-93db6816-a8a8-4330-a607-e79a8a47b07f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:39.112093 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-93db6816-a8a8-4330-a607-e79a8a47b07f tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1515 microversion: 2.1 time: 0.149140 Sep 08 13:56:39.112649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 269/530] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:38 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:39.382705 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-87c7c080-6922-40f6-a2cf-9750cc9f8328 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:39.383350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-87c7c080-6922-40f6-a2cf-9750cc9f8328 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:39.389859 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c7c080-6922-40f6-a2cf-9750cc9f8328 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:39.389859 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c7c080-6922-40f6-a2cf-9750cc9f8328 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:39.390273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c7c080-6922-40f6-a2cf-9750cc9f8328 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:39.390959 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c7c080-6922-40f6-a2cf-9750cc9f8328 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:39.391411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c7c080-6922-40f6-a2cf-9750cc9f8328 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:39.391830 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-87c7c080-6922-40f6-a2cf-9750cc9f8328 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:39.522070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-87c7c080-6922-40f6-a2cf-9750cc9f8328 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:39.530606 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-87c7c080-6922-40f6-a2cf-9750cc9f8328 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1683 microversion: 2.1 time: 0.151764 Sep 08 13:56:39.531246 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 262/531] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:39 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:39.987326 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:39.987930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:39.994411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:39.994887 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:39.995318 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:39.995998 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:39.996446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:39.996859 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:40.012333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1d9fd1c6-9fb4-417e-96f3-69fd51dcd5e8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:40.012945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1d9fd1c6-9fb4-417e-96f3-69fd51dcd5e8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:40.019667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9fd1c6-9fb4-417e-96f3-69fd51dcd5e8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:40.020158 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9fd1c6-9fb4-417e-96f3-69fd51dcd5e8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:40.020595 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9fd1c6-9fb4-417e-96f3-69fd51dcd5e8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:40.021296 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9fd1c6-9fb4-417e-96f3-69fd51dcd5e8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:40.021762 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9fd1c6-9fb4-417e-96f3-69fd51dcd5e8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:40.022193 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1d9fd1c6-9fb4-417e-96f3-69fd51dcd5e8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:40.191251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:40.199357 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:40.200790 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:40.202511 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-45ecdcb7-f449-4a13-8230-0e482287c5da tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.219057 Sep 08 13:56:40.203268 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 270/532] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:39 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:40.207771 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d97c0174-079e-49f7-84d1-f8c831f54108 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:40.208373 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d97c0174-079e-49f7-84d1-f8c831f54108 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:40.214367 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97c0174-079e-49f7-84d1-f8c831f54108 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:40.214869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97c0174-079e-49f7-84d1-f8c831f54108 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:40.215448 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97c0174-079e-49f7-84d1-f8c831f54108 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:40.216139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97c0174-079e-49f7-84d1-f8c831f54108 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:40.216608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97c0174-079e-49f7-84d1-f8c831f54108 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:40.217073 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d97c0174-079e-49f7-84d1-f8c831f54108 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:40.223998 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1d9fd1c6-9fb4-417e-96f3-69fd51dcd5e8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:40.231993 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1d9fd1c6-9fb4-417e-96f3-69fd51dcd5e8 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.223469 Sep 08 13:56:40.232560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 263/533] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:40 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:40.348598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d97c0174-079e-49f7-84d1-f8c831f54108 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:40.356312 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d97c0174-079e-49f7-84d1-f8c831f54108 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1515 microversion: 2.1 time: 0.152078 Sep 08 13:56:40.356921 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 271/534] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:40 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:40.553885 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d9eba051-4ff9-4e3a-a661-d3e4a586a6cc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:40.554422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d9eba051-4ff9-4e3a-a661-d3e4a586a6cc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:40.560343 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9eba051-4ff9-4e3a-a661-d3e4a586a6cc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:40.561389 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9eba051-4ff9-4e3a-a661-d3e4a586a6cc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:40.561849 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9eba051-4ff9-4e3a-a661-d3e4a586a6cc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:40.562537 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9eba051-4ff9-4e3a-a661-d3e4a586a6cc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:40.562990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9eba051-4ff9-4e3a-a661-d3e4a586a6cc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:40.563411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d9eba051-4ff9-4e3a-a661-d3e4a586a6cc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:40.740832 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d9eba051-4ff9-4e3a-a661-d3e4a586a6cc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:40.748841 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d9eba051-4ff9-4e3a-a661-d3e4a586a6cc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1683 microversion: 2.1 time: 0.198388 Sep 08 13:56:40.749396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 264/535] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:40 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1683 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:41.229540 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:41.230215 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:41.236446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:41.236927 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:41.237357 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:41.238074 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:41.238527 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:41.238950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:41.254596 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-61cf89ff-6845-48cb-a02b-7050619e08b5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:41.255231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-61cf89ff-6845-48cb-a02b-7050619e08b5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:41.261393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cf89ff-6845-48cb-a02b-7050619e08b5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:41.261912 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cf89ff-6845-48cb-a02b-7050619e08b5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:41.262341 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cf89ff-6845-48cb-a02b-7050619e08b5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:41.263023 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cf89ff-6845-48cb-a02b-7050619e08b5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:41.263466 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cf89ff-6845-48cb-a02b-7050619e08b5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:41.264373 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61cf89ff-6845-48cb-a02b-7050619e08b5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:41.284100 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:41.432284 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:41.440373 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:41.441828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:41.442980 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9e5ea8a7-fe7a-452d-9788-70148faa45b9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.217549 Sep 08 13:56:41.456650 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 272/536] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:41 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:41.456650 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cf8103b2-6c7a-4558-be28-ad5f34270fde tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:41.456650 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cf8103b2-6c7a-4558-be28-ad5f34270fde tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:41.456650 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8103b2-6c7a-4558-be28-ad5f34270fde tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:41.457227 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8103b2-6c7a-4558-be28-ad5f34270fde tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:41.457227 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8103b2-6c7a-4558-be28-ad5f34270fde tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:41.457227 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8103b2-6c7a-4558-be28-ad5f34270fde tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:41.457480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-61cf89ff-6845-48cb-a02b-7050619e08b5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:41.457588 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8103b2-6c7a-4558-be28-ad5f34270fde tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:41.457588 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf8103b2-6c7a-4558-be28-ad5f34270fde tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:41.466759 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-61cf89ff-6845-48cb-a02b-7050619e08b5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.215819 Sep 08 13:56:41.467849 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 265/537] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:41 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:41.591527 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-cf8103b2-6c7a-4558-be28-ad5f34270fde tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:41.599371 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cf8103b2-6c7a-4558-be28-ad5f34270fde tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1515 microversion: 2.1 time: 0.154901 Sep 08 13:56:41.599935 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 273/538] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:41 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:41.771321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8cffc2ac-588f-433f-84a3-02a77d59b311 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:41.771945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8cffc2ac-588f-433f-84a3-02a77d59b311 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:41.777812 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cffc2ac-588f-433f-84a3-02a77d59b311 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:41.778308 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cffc2ac-588f-433f-84a3-02a77d59b311 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:41.778734 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cffc2ac-588f-433f-84a3-02a77d59b311 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:41.779409 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cffc2ac-588f-433f-84a3-02a77d59b311 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:41.779866 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cffc2ac-588f-433f-84a3-02a77d59b311 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:41.780259 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8cffc2ac-588f-433f-84a3-02a77d59b311 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:41.908529 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8cffc2ac-588f-433f-84a3-02a77d59b311 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:41.916216 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8cffc2ac-588f-433f-84a3-02a77d59b311 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1683 microversion: 2.1 time: 0.148690 Sep 08 13:56:41.916772 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 266/539] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:41 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:42.469250 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:42.469904 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:42.476400 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:42.476882 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:42.477318 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:42.478034 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:42.478487 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:42.478907 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:42.490216 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c72f791e-9bfb-411c-a11f-39979def3c32 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:42.490826 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c72f791e-9bfb-411c-a11f-39979def3c32 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:42.497242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72f791e-9bfb-411c-a11f-39979def3c32 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:42.497723 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72f791e-9bfb-411c-a11f-39979def3c32 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:42.498218 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72f791e-9bfb-411c-a11f-39979def3c32 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:42.499313 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72f791e-9bfb-411c-a11f-39979def3c32 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:42.499770 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72f791e-9bfb-411c-a11f-39979def3c32 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:42.500224 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c72f791e-9bfb-411c-a11f-39979def3c32 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:42.669018 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:42.677606 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:42.679076 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:42.680221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-731989fd-c0f7-4dbc-9fe0-de637936e0e5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.215397 Sep 08 13:56:42.680783 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 274/540] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:42 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:42.686753 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d532555b-51d0-4e1a-8e78-c55ab2d98844 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:42.686753 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d532555b-51d0-4e1a-8e78-c55ab2d98844 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:42.691495 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d532555b-51d0-4e1a-8e78-c55ab2d98844 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:42.691977 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d532555b-51d0-4e1a-8e78-c55ab2d98844 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:42.692417 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d532555b-51d0-4e1a-8e78-c55ab2d98844 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:42.693101 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d532555b-51d0-4e1a-8e78-c55ab2d98844 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:42.693554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d532555b-51d0-4e1a-8e78-c55ab2d98844 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:42.693992 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d532555b-51d0-4e1a-8e78-c55ab2d98844 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:42.698234 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:42.707463 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c72f791e-9bfb-411c-a11f-39979def3c32 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:42.716158 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c72f791e-9bfb-411c-a11f-39979def3c32 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.229614 Sep 08 13:56:42.717019 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 267/541] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:42 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:42.821871 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d532555b-51d0-4e1a-8e78-c55ab2d98844 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:42.829943 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d532555b-51d0-4e1a-8e78-c55ab2d98844 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1515 microversion: 2.1 time: 0.148121 Sep 08 13:56:42.830543 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 275/542] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:42 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:42.937956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e6f1ae43-f93c-456c-8c85-497da8bd4ce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:42.938562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e6f1ae43-f93c-456c-8c85-497da8bd4ce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:42.944547 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6f1ae43-f93c-456c-8c85-497da8bd4ce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:42.945020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6f1ae43-f93c-456c-8c85-497da8bd4ce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:42.945450 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6f1ae43-f93c-456c-8c85-497da8bd4ce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:42.946154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6f1ae43-f93c-456c-8c85-497da8bd4ce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:42.946598 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6f1ae43-f93c-456c-8c85-497da8bd4ce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:42.947014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e6f1ae43-f93c-456c-8c85-497da8bd4ce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:43.079282 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e6f1ae43-f93c-456c-8c85-497da8bd4ce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:43.086881 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e6f1ae43-f93c-456c-8c85-497da8bd4ce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1683 microversion: 2.1 time: 0.152749 Sep 08 13:56:43.087442 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 268/543] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:42 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:43.408791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0f7753ac-dde8-45f4-9e42-a6b20a27be52 req-6006b927-bef8-49c6-b717-88cc5d31858b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959f81c9-4c88-41e0-8eb9-e5b3fb5faa32", "name": "network-vif-unplugged", "status": "completed", "tag": "c56674e2-ad46-43bc-9f41-cf0a4987597f"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:43.418633 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0f7753ac-dde8-45f4-9e42-a6b20a27be52 req-6006b927-bef8-49c6-b717-88cc5d31858b service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:43.419115 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0f7753ac-dde8-45f4-9e42-a6b20a27be52 req-6006b927-bef8-49c6-b717-88cc5d31858b service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:43.419541 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0f7753ac-dde8-45f4-9e42-a6b20a27be52 req-6006b927-bef8-49c6-b717-88cc5d31858b service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:43.431045 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0f7753ac-dde8-45f4-9e42-a6b20a27be52 req-6006b927-bef8-49c6-b717-88cc5d31858b service nova] Creating event network-vif-unplugged:c56674e2-ad46-43bc-9f41-cf0a4987597f for instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 on hv-cinder-82002 Sep 08 13:56:43.435951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0f7753ac-dde8-45f4-9e42-a6b20a27be52 req-6006b927-bef8-49c6-b717-88cc5d31858b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030792 Sep 08 13:56:43.436714 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 276/544] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:43.706244 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:43.706846 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:43.713198 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:43.713974 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:43.714412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:43.715098 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:43.715576 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:43.716005 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:43.741240 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dfdf0d60-2068-4073-b1e6-09bc32aad4bf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:43.741966 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dfdf0d60-2068-4073-b1e6-09bc32aad4bf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:43.748009 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfdf0d60-2068-4073-b1e6-09bc32aad4bf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:43.748485 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfdf0d60-2068-4073-b1e6-09bc32aad4bf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:43.748914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfdf0d60-2068-4073-b1e6-09bc32aad4bf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:43.749596 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfdf0d60-2068-4073-b1e6-09bc32aad4bf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:43.750073 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfdf0d60-2068-4073-b1e6-09bc32aad4bf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:43.750490 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dfdf0d60-2068-4073-b1e6-09bc32aad4bf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:43.895319 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:43.903392 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:43.904841 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:43.906033 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca5e6541-f832-4853-b417-0f46ca87ff54 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.203667 Sep 08 13:56:43.907722 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 269/545] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:43 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:43.911194 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8de68339-8e4f-41ae-b7da-ad9606d5a3a2 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:43.911788 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8de68339-8e4f-41ae-b7da-ad9606d5a3a2 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:43.917573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8de68339-8e4f-41ae-b7da-ad9606d5a3a2 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:43.918076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8de68339-8e4f-41ae-b7da-ad9606d5a3a2 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:43.918501 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8de68339-8e4f-41ae-b7da-ad9606d5a3a2 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:43.919184 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8de68339-8e4f-41ae-b7da-ad9606d5a3a2 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:43.919626 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8de68339-8e4f-41ae-b7da-ad9606d5a3a2 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:43.920043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8de68339-8e4f-41ae-b7da-ad9606d5a3a2 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:43.938580 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-dfdf0d60-2068-4073-b1e6-09bc32aad4bf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:43.946876 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dfdf0d60-2068-4073-b1e6-09bc32aad4bf tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.210318 Sep 08 13:56:43.947434 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 277/546] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:43 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:44.052605 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8de68339-8e4f-41ae-b7da-ad9606d5a3a2 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:44.061063 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8de68339-8e4f-41ae-b7da-ad9606d5a3a2 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1515 microversion: 2.1 time: 0.153008 Sep 08 13:56:44.061632 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 270/547] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:43 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:44.110031 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86750d82-11ea-4668-90a1-7a48311bcb43 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:44.110764 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86750d82-11ea-4668-90a1-7a48311bcb43 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:44.116734 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86750d82-11ea-4668-90a1-7a48311bcb43 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:44.117291 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86750d82-11ea-4668-90a1-7a48311bcb43 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:44.117822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86750d82-11ea-4668-90a1-7a48311bcb43 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:44.118606 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86750d82-11ea-4668-90a1-7a48311bcb43 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:44.119139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86750d82-11ea-4668-90a1-7a48311bcb43 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:44.119622 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86750d82-11ea-4668-90a1-7a48311bcb43 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:44.252960 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-86750d82-11ea-4668-90a1-7a48311bcb43 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:44.260563 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86750d82-11ea-4668-90a1-7a48311bcb43 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1683 microversion: 2.1 time: 0.154442 Sep 08 13:56:44.261119 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 278/548] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:44 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:44.932452 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:44.933272 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:44.940438 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:44.940918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:44.941361 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:44.942075 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:44.942519 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:44.942935 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:44.973917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-36f275a0-1f22-4f9d-860f-438ae6273d93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:44.975260 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-36f275a0-1f22-4f9d-860f-438ae6273d93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:44.982046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36f275a0-1f22-4f9d-860f-438ae6273d93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:44.983231 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36f275a0-1f22-4f9d-860f-438ae6273d93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:44.984173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36f275a0-1f22-4f9d-860f-438ae6273d93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:44.984945 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36f275a0-1f22-4f9d-860f-438ae6273d93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:44.985520 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36f275a0-1f22-4f9d-860f-438ae6273d93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:44.986032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-36f275a0-1f22-4f9d-860f-438ae6273d93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:45.550072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:45.559482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:45.561399 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:45.562151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77a1ba01-a5f6-4578-b8dc-4605a81768bb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.634615 Sep 08 13:56:45.562704 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 271/549] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:44 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:45.567207 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f1f62b2f-ee95-4fc7-88bb-ed610e7de5ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:45.567886 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f1f62b2f-ee95-4fc7-88bb-ed610e7de5ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:45.573758 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f62b2f-ee95-4fc7-88bb-ed610e7de5ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:45.574254 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f62b2f-ee95-4fc7-88bb-ed610e7de5ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:45.574691 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f62b2f-ee95-4fc7-88bb-ed610e7de5ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:45.575382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f62b2f-ee95-4fc7-88bb-ed610e7de5ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:45.575877 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f62b2f-ee95-4fc7-88bb-ed610e7de5ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:45.576321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f1f62b2f-ee95-4fc7-88bb-ed610e7de5ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:45.585525 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-36f275a0-1f22-4f9d-860f-438ae6273d93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:45.595897 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-36f275a0-1f22-4f9d-860f-438ae6273d93 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1756 microversion: 2.1 time: 0.627269 Sep 08 13:56:45.596473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 279/550] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:44 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1756 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:45.614984 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98b43398-11df-4880-9c1b-26aee45648d3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:45.615599 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-98b43398-11df-4880-9c1b-26aee45648d3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:45.621369 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98b43398-11df-4880-9c1b-26aee45648d3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:45.621951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98b43398-11df-4880-9c1b-26aee45648d3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:45.622387 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98b43398-11df-4880-9c1b-26aee45648d3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:45.623132 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98b43398-11df-4880-9c1b-26aee45648d3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:45.623604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98b43398-11df-4880-9c1b-26aee45648d3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:45.624027 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98b43398-11df-4880-9c1b-26aee45648d3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:45.768936 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-98b43398-11df-4880-9c1b-26aee45648d3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:45.777455 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-98b43398-11df-4880-9c1b-26aee45648d3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1615 microversion: 2.1 time: 0.166482 Sep 08 13:56:45.789786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 280/551] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:45 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1615 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:45.943300 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f1f62b2f-ee95-4fc7-88bb-ed610e7de5ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:45.953327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f1f62b2f-ee95-4fc7-88bb-ed610e7de5ef tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1515 microversion: 2.1 time: 0.389530 Sep 08 13:56:45.961767 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 272/552] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:45 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1515 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:45.989445 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e7c4a813-4582-4ce3-96cd-7018c384049f req-cf038acc-971f-48ac-a4a2-83670c81df5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a3e9d6-2e31-4f70-ae65-a40552851588", "name": "network-vif-deleted", "tag": "b9784d38-d516-4bbc-af3e-459cad3ad635"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:45.999868 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e7c4a813-4582-4ce3-96cd-7018c384049f req-cf038acc-971f-48ac-a4a2-83670c81df5f service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:46.000349 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e7c4a813-4582-4ce3-96cd-7018c384049f req-cf038acc-971f-48ac-a4a2-83670c81df5f service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:46.000784 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e7c4a813-4582-4ce3-96cd-7018c384049f req-cf038acc-971f-48ac-a4a2-83670c81df5f service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:46.012664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e7c4a813-4582-4ce3-96cd-7018c384049f req-cf038acc-971f-48ac-a4a2-83670c81df5f service nova] Creating event network-vif-deleted:b9784d38-d516-4bbc-af3e-459cad3ad635 for instance a3a3e9d6-2e31-4f70-ae65-a40552851588 on hv-cinder-82002 Sep 08 13:56:46.018485 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e7c4a813-4582-4ce3-96cd-7018c384049f req-cf038acc-971f-48ac-a4a2-83670c81df5f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032783 Sep 08 13:56:46.019279 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 281/553] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:46.588122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:46.601333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:46.608729 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:46.609335 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:46.610070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:46.610987 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:46.611441 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:46.611889 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:46.624029 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0f3aa7f9-6ef9-4714-bfa7-53b78ce6b8d5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:46.625058 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0f3aa7f9-6ef9-4714-bfa7-53b78ce6b8d5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:46.631920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f3aa7f9-6ef9-4714-bfa7-53b78ce6b8d5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:46.632778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f3aa7f9-6ef9-4714-bfa7-53b78ce6b8d5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:46.633435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f3aa7f9-6ef9-4714-bfa7-53b78ce6b8d5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:46.634382 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f3aa7f9-6ef9-4714-bfa7-53b78ce6b8d5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:46.635049 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f3aa7f9-6ef9-4714-bfa7-53b78ce6b8d5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:46.635685 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0f3aa7f9-6ef9-4714-bfa7-53b78ce6b8d5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:46.823209 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:46.834566 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:46.836176 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:46.837941 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2d54b038-4573-4f29-b584-63bb610bcb59 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1743 microversion: 2.20 time: 0.253526 Sep 08 13:56:46.838882 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 273/554] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:46 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:46.856555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0f3aa7f9-6ef9-4714-bfa7-53b78ce6b8d5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:46.862530 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5352fef2-a15d-48cb-a617-c4148f2e70a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:46.863293 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5352fef2-a15d-48cb-a617-c4148f2e70a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:46.866977 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0f3aa7f9-6ef9-4714-bfa7-53b78ce6b8d5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1759 microversion: 2.1 time: 0.248864 Sep 08 13:56:46.868739 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 282/555] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:46 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1759 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:46.869762 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5352fef2-a15d-48cb-a617-c4148f2e70a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:46.870411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5352fef2-a15d-48cb-a617-c4148f2e70a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:46.870944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5352fef2-a15d-48cb-a617-c4148f2e70a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:46.871744 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5352fef2-a15d-48cb-a617-c4148f2e70a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:46.872313 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5352fef2-a15d-48cb-a617-c4148f2e70a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:46.872879 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5352fef2-a15d-48cb-a617-c4148f2e70a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:46.940878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5352fef2-a15d-48cb-a617-c4148f2e70a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:46.948880 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5352fef2-a15d-48cb-a617-c4148f2e70a5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1615 microversion: 2.1 time: 0.093859 Sep 08 13:56:46.950331 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 274/556] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:46 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1615 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:46.977681 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d1b7e985-1b63-46cf-be29-c6d6c04ec70b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:46.978347 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1b7e985-1b63-46cf-be29-c6d6c04ec70b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:46.985436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1b7e985-1b63-46cf-be29-c6d6c04ec70b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:46.985969 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1b7e985-1b63-46cf-be29-c6d6c04ec70b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:46.986475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1b7e985-1b63-46cf-be29-c6d6c04ec70b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:46.987286 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1b7e985-1b63-46cf-be29-c6d6c04ec70b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:46.987804 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1b7e985-1b63-46cf-be29-c6d6c04ec70b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:46.988394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1b7e985-1b63-46cf-be29-c6d6c04ec70b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:47.053057 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1b7e985-1b63-46cf-be29-c6d6c04ec70b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:47.062553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d1b7e985-1b63-46cf-be29-c6d6c04ec70b tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1304 microversion: 2.1 time: 0.088787 Sep 08 13:56:47.073757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 283/557] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:46 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:47.868503 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:47.869111 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:47.875636 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:47.876118 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:47.876547 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:47.877229 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:47.877684 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:47.878130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:47.972628 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:47.973309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:47.979998 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:47.980485 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:47.980918 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:47.981621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:47.982939 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:47.983368 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:48.045356 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:48.057048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:48.057604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:48.057983 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:48.058610 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lazy-loading 'fault' on Instance uuid 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:56:48.058820 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:48.061386 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:48.062982 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5201de3e-831d-42fb-a80c-b13996829e85 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1743 microversion: 2.20 time: 0.198406 Sep 08 13:56:48.063807 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 275/558] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:47 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1743 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:48.069304 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f98c56c5-3ea6-4b44-a51b-805e2f180b45 req-927d02fc-fe12-410f-9e9a-d734c6ed9930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959f81c9-4c88-41e0-8eb9-e5b3fb5faa32", "name": "network-vif-deleted", "tag": "c56674e2-ad46-43bc-9f41-cf0a4987597f"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:48.081898 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f98c56c5-3ea6-4b44-a51b-805e2f180b45 req-927d02fc-fe12-410f-9e9a-d734c6ed9930 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:48.082647 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f98c56c5-3ea6-4b44-a51b-805e2f180b45 req-927d02fc-fe12-410f-9e9a-d734c6ed9930 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:48.084031 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f98c56c5-3ea6-4b44-a51b-805e2f180b45 req-927d02fc-fe12-410f-9e9a-d734c6ed9930 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:48.106906 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f98c56c5-3ea6-4b44-a51b-805e2f180b45 req-927d02fc-fe12-410f-9e9a-d734c6ed9930 service nova] Creating event network-vif-deleted:c56674e2-ad46-43bc-9f41-cf0a4987597f for instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 on hv-cinder-82002 Sep 08 13:56:48.112093 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f98c56c5-3ea6-4b44-a51b-805e2f180b45 req-927d02fc-fe12-410f-9e9a-d734c6ed9930 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046959 Sep 08 13:56:48.112997 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 276/559] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:48.118215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:48.119094 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:48.125299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:48.125828 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:48.126256 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:48.126960 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:48.127409 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:48.127831 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:48.129229 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:48.137842 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ccf1d5c-73b5-4b9b-8a17-f021ca588fb4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 200 len: 1331 microversion: 2.1 time: 0.169267 Sep 08 13:56:48.139716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 284/560] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:47 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 1331 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:48.163603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:48.164080 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:48.164507 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:48.164973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lazy-loading 'fault' on Instance uuid a3a3e9d6-2e31-4f70-ae65-a40552851588 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:56:48.207863 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:48.216093 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-36c5a5e6-d2c1-46ae-bed8-e49993646add tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1309 microversion: 2.1 time: 0.101802 Sep 08 13:56:48.217632 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 277/561] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:48 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:49.092709 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:49.093330 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:49.099818 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:49.100311 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:49.100743 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:49.101439 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:49.102103 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:49.102562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:49.161992 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:49.162889 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:49.169999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:49.170770 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:49.171420 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:49.172406 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:49.173185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:49.174218 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:49.190134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 HTTP/1.1 Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:56:49.191787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 13:56:49.193401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '959f81c9-4c88-41e0-8eb9-e5b3fb5faa32'} Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:56:49.194391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 13:56:49.196833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:56:49.198671 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:56:49.199177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0ab73261-dc81-400f-8503-896fc7f6c719 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 404 len: 111 microversion: 2.1 time: 0.035434 Sep 08 13:56:49.199851 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 278/562] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:49 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:56:49.208347 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-919d949e-d978-4e5b-96ca-28d611e12628 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '.version_select at 0x7f5be4627700>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:49.230682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-919d949e-d978-4e5b-96ca-28d611e12628 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-297537427" status: 202 len: 0 microversion: 2.1 time: 0.025847 Sep 08 13:56:49.231255 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 279/563] 10.222.0.55 () {58 vars in 1218 bytes} [Thu Sep 8 13:56:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-297537427 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:56:49.249627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:49.250762 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:49.251388 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:49.258555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:49.260012 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:49.261188 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a810faa0-2292-432f-adb1-ac17ba0505d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1743 microversion: 2.20 time: 0.172709 Sep 08 13:56:49.270094 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:49.270255 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 285/564] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:49 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:49.271068 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:49.271732 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:49.272730 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:49.273417 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:49.274144 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:49.309941 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:49.311000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:49.311612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:49.312269 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lazy-loading 'fault' on Instance uuid a3a3e9d6-2e31-4f70-ae65-a40552851588 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:56:49.358846 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93b5304ecec4ceca33da4b58e8e2480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0375e7ef3fb04600b5d4095057658bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:49.366804 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-913d5590-4da4-4c8f-b924-ce768eab0492 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 200 len: 1309 microversion: 2.1 time: 0.120277 Sep 08 13:56:49.381761 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 280/565] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:49 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:49.492190 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e3502c20-cd1e-4008-879b-2137bf31913b req-e91a214d-3865-45a4-bc58-4a7cf2cb5f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdb4c65-ed8d-4792-ac96-8b1053b167b5", "name": "network-vif-plugged", "status": "completed", "tag": "c9da782b-975b-4d78-bc93-092cf58fcf3a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:49.503271 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e3502c20-cd1e-4008-879b-2137bf31913b req-e91a214d-3865-45a4-bc58-4a7cf2cb5f55 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:49.503947 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e3502c20-cd1e-4008-879b-2137bf31913b req-e91a214d-3865-45a4-bc58-4a7cf2cb5f55 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:49.504476 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e3502c20-cd1e-4008-879b-2137bf31913b req-e91a214d-3865-45a4-bc58-4a7cf2cb5f55 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:49.521353 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e3502c20-cd1e-4008-879b-2137bf31913b req-e91a214d-3865-45a4-bc58-4a7cf2cb5f55 service nova] Creating event network-vif-plugged:c9da782b-975b-4d78-bc93-092cf58fcf3a for instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 on hv-cinder-82002 Sep 08 13:56:49.527297 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e3502c20-cd1e-4008-879b-2137bf31913b req-e91a214d-3865-45a4-bc58-4a7cf2cb5f55 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039226 Sep 08 13:56:49.528499 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 286/566] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:49.971134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-94186456-7c46-4d4e-9ef2-18c27a852c9a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:49.971631 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-94186456-7c46-4d4e-9ef2-18c27a852c9a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:49.978151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94186456-7c46-4d4e-9ef2-18c27a852c9a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:49.978962 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94186456-7c46-4d4e-9ef2-18c27a852c9a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:49.979570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94186456-7c46-4d4e-9ef2-18c27a852c9a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:49.981094 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94186456-7c46-4d4e-9ef2-18c27a852c9a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:49.981643 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94186456-7c46-4d4e-9ef2-18c27a852c9a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:49.982874 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-94186456-7c46-4d4e-9ef2-18c27a852c9a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:50.115855 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-94186456-7c46-4d4e-9ef2-18c27a852c9a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lazy-loading 'services' on Instance uuid c6a4b8e4-4292-4db0-89b6-b09f84f513ce {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:56:50.240977 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-94186456-7c46-4d4e-9ef2-18c27a852c9a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-volume_attachments/ab642d3d-1712-4435-a8e6-3ab0eb1375c2" status: 202 len: 0 microversion: 2.1 time: 0.274138 Sep 08 13:56:50.241680 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 281/567] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 13:56:49 2022] DELETE /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-volume_attachments/ab642d3d-1712-4435-a8e6-3ab0eb1375c2 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:56:50.250950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad25e58b-c76e-48e9-bb30-f03502341dd2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:50.254153 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad25e58b-c76e-48e9-bb30-f03502341dd2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:50.261332 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad25e58b-c76e-48e9-bb30-f03502341dd2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:50.262081 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad25e58b-c76e-48e9-bb30-f03502341dd2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:50.262516 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad25e58b-c76e-48e9-bb30-f03502341dd2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:50.263972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad25e58b-c76e-48e9-bb30-f03502341dd2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:50.264596 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad25e58b-c76e-48e9-bb30-f03502341dd2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:50.265329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad25e58b-c76e-48e9-bb30-f03502341dd2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:50.290308 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:50.291076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:50.302660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:50.302971 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad25e58b-c76e-48e9-bb30-f03502341dd2 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056145 Sep 08 13:56:50.303112 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:50.303520 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:50.309528 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 287/568] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:56:50 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:50.310669 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:50.311181 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:50.311659 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:50.393060 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:50.393841 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] [instance: a3a3e9d6-2e31-4f70-ae65-a40552851588] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:50.400595 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:50.401075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:50.401659 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:50.402521 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:50.403123 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:50.403860 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:50.425481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] HTTP exception thrown: Instance a3a3e9d6-2e31-4f70-ae65-a40552851588 could not be found. Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Request method failure captured: Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 HTTP/1.1 Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfP-qFAIKKmruQX512LwbyxgfLxfm_KyJHARo4HQLbvikwq-3AoP3kgUzKZ2TLvfK6hFRMMOBfN2LDR7IAVv8B81YD_mdJlAIFORM1mhUO_tMDwV_C8hZ4335mk5ZHI7r3OmynlB9EQ-jo-YRcXX9681tnAM_gV9UsYd3_eD9ZgPFpo Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 0375e7ef3fb04600b5d4095057658bc7 Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-VolumesSnapshotTestJSON-251370117 Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:56:50.427335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0375e7ef3fb04600b5d4095057658bc7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0375e7ef3fb04600b5d4095057658bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0375e7ef3fb04600b5d4095057658bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0375e7ef3fb04600b5d4095057658bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-VolumesSnapshotTestJSON-251370117 Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 0375e7ef3fb04600b5d4095057658bc7 Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-251370117 Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-VolumesSnapshotTestJSON-251370117-project Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: e93b5304ecec4ceca33da4b58e8e2480 Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-VolumesSnapshotTestJSON-251370117-project Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance a3a3e9d6-2e31-4f70-ae65-a40552851588 could not be found. Sep 08 13:56:50.428901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': 'a3a3e9d6-2e31-4f70-ae65-a40552851588'} Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a3e9d6-2e31-4f70-ae65-a40552851588 could not be found. Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:56:50.429757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a3e9d6-2e31-4f70-ae65-a40552851588 could not be found. Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a3e9d6-2e31-4f70-ae65-a40552851588 could not be found. Sep 08 13:56:50.431163 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:56:50.433095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] Returning 404 to user: Instance a3a3e9d6-2e31-4f70-ae65-a40552851588 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:56:50.434389 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-425c466c-a8c4-43cf-b95b-3ee7a96e3727 tempest-VolumesSnapshotTestJSON-251370117 tempest-VolumesSnapshotTestJSON-251370117-project] 10.222.0.55 "GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588" status: 404 len: 111 microversion: 2.1 time: 0.045635 Sep 08 13:56:50.437029 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 288/569] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:50 2022] GET /compute/v2.1/servers/a3a3e9d6-2e31-4f70-ae65-a40552851588 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:56:50.487072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:50.496123 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:50.497704 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:50.499147 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9acdfc21-5e2b-460e-895c-a38ca3dfaeab tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1738 microversion: 2.20 time: 0.215565 Sep 08 13:56:50.500098 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 282/570] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:50 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:51.316801 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a9dff169-fd65-4fa7-8a24-5b18dbc8bb62 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:51.319119 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a9dff169-fd65-4fa7-8a24-5b18dbc8bb62 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:51.325655 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dff169-fd65-4fa7-8a24-5b18dbc8bb62 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:51.326828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dff169-fd65-4fa7-8a24-5b18dbc8bb62 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:51.327334 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dff169-fd65-4fa7-8a24-5b18dbc8bb62 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:51.328095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dff169-fd65-4fa7-8a24-5b18dbc8bb62 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:51.328756 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dff169-fd65-4fa7-8a24-5b18dbc8bb62 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:51.329374 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9dff169-fd65-4fa7-8a24-5b18dbc8bb62 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:51.366455 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a9dff169-fd65-4fa7-8a24-5b18dbc8bb62 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053621 Sep 08 13:56:51.367215 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 289/571] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:56:51 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:51.526660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:51.527476 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:51.534618 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:51.535455 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:51.535952 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:51.536721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:51.537232 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:51.537752 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:51.542163 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:51.701318 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:51.710177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:51.712826 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:51.715450 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1e540a20-b990-4bf2-82d8-e49b800edf5b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1738 microversion: 2.20 time: 0.193698 Sep 08 13:56:51.716701 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 283/572] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:51 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:52.378367 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e3091393-2937-4fd8-a7ca-9071cf5b688c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:52.380729 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e3091393-2937-4fd8-a7ca-9071cf5b688c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:52.387070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3091393-2937-4fd8-a7ca-9071cf5b688c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:52.387544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3091393-2937-4fd8-a7ca-9071cf5b688c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:52.388181 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3091393-2937-4fd8-a7ca-9071cf5b688c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:52.389053 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3091393-2937-4fd8-a7ca-9071cf5b688c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:52.389505 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3091393-2937-4fd8-a7ca-9071cf5b688c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:52.389943 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e3091393-2937-4fd8-a7ca-9071cf5b688c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:52.421348 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e3091393-2937-4fd8-a7ca-9071cf5b688c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046950 Sep 08 13:56:52.422329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 290/573] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:56:52 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:56:52.497523 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-000290b5-7cb4-46ca-9b2d-40a438a9098f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:52.498131 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-000290b5-7cb4-46ca-9b2d-40a438a9098f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:52.504373 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-000290b5-7cb4-46ca-9b2d-40a438a9098f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:52.505335 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-000290b5-7cb4-46ca-9b2d-40a438a9098f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:52.505628 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-000290b5-7cb4-46ca-9b2d-40a438a9098f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:52.506355 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-000290b5-7cb4-46ca-9b2d-40a438a9098f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:52.506972 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-000290b5-7cb4-46ca-9b2d-40a438a9098f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:52.507388 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-000290b5-7cb4-46ca-9b2d-40a438a9098f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:52.537054 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-000290b5-7cb4-46ca-9b2d-40a438a9098f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:56:52.629272 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-000290b5-7cb4-46ca-9b2d-40a438a9098f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 204 len: 0 microversion: 2.1 time: 0.135957 Sep 08 13:56:52.630495 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 284/574] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:56:52 2022] DELETE /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:56:52.641269 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac32f79a-fca5-48f7-a80d-b298e904ef0b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:52.642296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac32f79a-fca5-48f7-a80d-b298e904ef0b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:52.651893 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac32f79a-fca5-48f7-a80d-b298e904ef0b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:52.652799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac32f79a-fca5-48f7-a80d-b298e904ef0b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:52.653409 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac32f79a-fca5-48f7-a80d-b298e904ef0b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:52.654811 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac32f79a-fca5-48f7-a80d-b298e904ef0b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:52.655273 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac32f79a-fca5-48f7-a80d-b298e904ef0b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:52.655744 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac32f79a-fca5-48f7-a80d-b298e904ef0b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:52.741493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:52.742239 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:52.749153 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:52.757811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:52.757811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:52.757811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:52.757811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:52.758328 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:52.814366 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac32f79a-fca5-48f7-a80d-b298e904ef0b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:52.823275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac32f79a-fca5-48f7-a80d-b298e904ef0b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1683 microversion: 2.1 time: 0.188103 Sep 08 13:56:52.823871 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 291/575] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:52 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:52.934665 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:52.943513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:52.945002 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:52.946211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2583d54e-75a2-4393-b156-a309fb2156f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1738 microversion: 2.20 time: 0.209381 Sep 08 13:56:52.946991 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 285/576] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:52 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:53.848198 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-95d91f83-0d36-479f-ad3a-49396ef8179d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:53.848928 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-95d91f83-0d36-479f-ad3a-49396ef8179d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:53.858740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95d91f83-0d36-479f-ad3a-49396ef8179d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:53.859554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95d91f83-0d36-479f-ad3a-49396ef8179d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:53.859926 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95d91f83-0d36-479f-ad3a-49396ef8179d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:53.860627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95d91f83-0d36-479f-ad3a-49396ef8179d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:53.861074 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95d91f83-0d36-479f-ad3a-49396ef8179d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:53.861490 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95d91f83-0d36-479f-ad3a-49396ef8179d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:53.971741 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:53.972670 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:53.982833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:53.983654 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:53.984202 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:53.985025 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:53.985604 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:53.986148 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:54.024868 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-95d91f83-0d36-479f-ad3a-49396ef8179d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:54.033305 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-95d91f83-0d36-479f-ad3a-49396ef8179d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1683 microversion: 2.1 time: 0.189062 Sep 08 13:56:54.037858 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 292/577] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:53 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:54.144686 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:54.152976 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:54.154484 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:54.155664 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d8f1a0ea-d2c0-4a90-b86c-c356b57c2c68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1738 microversion: 2.20 time: 0.187777 Sep 08 13:56:54.156398 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 286/578] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:53 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:56:55.060243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-08d86244-ae43-483f-9d7d-cf56a6cd06ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:55.061024 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-08d86244-ae43-483f-9d7d-cf56a6cd06ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:55.067625 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d86244-ae43-483f-9d7d-cf56a6cd06ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:55.068111 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d86244-ae43-483f-9d7d-cf56a6cd06ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:55.068546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d86244-ae43-483f-9d7d-cf56a6cd06ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:55.069251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d86244-ae43-483f-9d7d-cf56a6cd06ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:55.069702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d86244-ae43-483f-9d7d-cf56a6cd06ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:55.070150 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-08d86244-ae43-483f-9d7d-cf56a6cd06ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:55.181708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:55.182355 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:55.189714 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:55.190234 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:55.190672 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:55.191805 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:55.192264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:55.192876 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:55.243820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-08d86244-ae43-483f-9d7d-cf56a6cd06ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:55.254076 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-08d86244-ae43-483f-9d7d-cf56a6cd06ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1683 microversion: 2.1 time: 0.197766 Sep 08 13:56:55.254660 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 293/579] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:55 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:55.358841 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:55.367070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:55.368482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:55.369627 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b7ffea0d-58dd-4c9b-ba2d-697915367a95 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1738 microversion: 2.20 time: 0.192203 Sep 08 13:56:55.370214 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 287/580] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:55 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:56.281945 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e88213a7-3293-43d5-890a-08b18d62a926 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:56.282724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e88213a7-3293-43d5-890a-08b18d62a926 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:56.297510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88213a7-3293-43d5-890a-08b18d62a926 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:56.298021 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88213a7-3293-43d5-890a-08b18d62a926 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:56.299144 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88213a7-3293-43d5-890a-08b18d62a926 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:56.299854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88213a7-3293-43d5-890a-08b18d62a926 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:56.300435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88213a7-3293-43d5-890a-08b18d62a926 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:56.300951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e88213a7-3293-43d5-890a-08b18d62a926 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:56.303915 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:56.395332 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:56.396512 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:56.405959 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:56.408957 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:56.409461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:56.410451 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:56.412958 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:56.413467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:56.584581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e88213a7-3293-43d5-890a-08b18d62a926 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:56.596371 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e88213a7-3293-43d5-890a-08b18d62a926 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1683 microversion: 2.1 time: 0.319150 Sep 08 13:56:56.597467 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 294/581] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:56 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1683 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:56.711698 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:56.736545 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:56.738304 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:56.739820 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ae763409-ab2c-4c16-a4f2-49a0f1d3e09c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1738 microversion: 2.20 time: 0.349033 Sep 08 13:56:56.740891 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 288/582] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:56 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1738 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:56:57.620023 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a8df80ce-8182-4e87-875c-f0a7a69ba6e9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:57.620765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a8df80ce-8182-4e87-875c-f0a7a69ba6e9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:57.627676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8df80ce-8182-4e87-875c-f0a7a69ba6e9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:57.628146 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8df80ce-8182-4e87-875c-f0a7a69ba6e9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:57.628568 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8df80ce-8182-4e87-875c-f0a7a69ba6e9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:57.629315 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8df80ce-8182-4e87-875c-f0a7a69ba6e9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:57.629784 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8df80ce-8182-4e87-875c-f0a7a69ba6e9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:57.630514 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a8df80ce-8182-4e87-875c-f0a7a69ba6e9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:57.765420 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:57.766187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:57.772770 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:57.773245 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:57.773674 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:57.777275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:57.780540 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:57.781197 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:57.823664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a8df80ce-8182-4e87-875c-f0a7a69ba6e9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:57.832851 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a8df80ce-8182-4e87-875c-f0a7a69ba6e9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1683 microversion: 2.1 time: 0.216832 Sep 08 13:56:57.834036 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 295/583] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:57 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1683 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:57.956627 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:57.967774 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:57.969410 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:57.970871 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a3b1f35c-daff-4365-8073-d8d2b84ed9e1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1738 microversion: 2.20 time: 0.209773 Sep 08 13:56:57.971558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 289/584] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:57 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:56:58.856085 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-de8a8040-1862-4531-9968-faae64f19fcc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:58.856989 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-de8a8040-1862-4531-9968-faae64f19fcc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:58.865528 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8a8040-1862-4531-9968-faae64f19fcc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:58.866138 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8a8040-1862-4531-9968-faae64f19fcc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:58.866648 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8a8040-1862-4531-9968-faae64f19fcc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:58.867558 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8a8040-1862-4531-9968-faae64f19fcc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:58.868098 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8a8040-1862-4531-9968-faae64f19fcc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:58.868595 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de8a8040-1862-4531-9968-faae64f19fcc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:58.999118 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:58.999725 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:59.015273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:59.016247 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:59.017209 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:59.021646 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:59.022362 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:59.022958 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:59.039023 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-de8a8040-1862-4531-9968-faae64f19fcc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:59.049385 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-de8a8040-1862-4531-9968-faae64f19fcc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1683 microversion: 2.1 time: 0.197317 Sep 08 13:56:59.053754 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 296/585] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:58 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1683 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:59.292537 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:59.307760 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:59.312183 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:59.316283 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a86e881d-714c-427d-856b-10d18223ae7d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1738 microversion: 2.20 time: 0.323749 Sep 08 13:56:59.318036 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 290/586] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:56:58 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:00.072210 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-adcd080d-e6ab-4041-bade-306b9ed9d75c req-8039f08a-b0d8-4792-9ab1-d32c87aef6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a4b8e4-4292-4db0-89b6-b09f84f513ce", "name": "network-vif-deleted", "tag": "94671fa2-8c0f-46c1-8d8a-12ec57a1598d"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:00.079269 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-28b587c8-c417-41b0-ac25-d3d787a81003 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:00.079971 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-28b587c8-c417-41b0-ac25-d3d787a81003 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:00.087113 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-adcd080d-e6ab-4041-bade-306b9ed9d75c req-8039f08a-b0d8-4792-9ab1-d32c87aef6eb service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:00.087309 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28b587c8-c417-41b0-ac25-d3d787a81003 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:00.087592 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-adcd080d-e6ab-4041-bade-306b9ed9d75c req-8039f08a-b0d8-4792-9ab1-d32c87aef6eb service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:00.087703 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28b587c8-c417-41b0-ac25-d3d787a81003 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:00.088020 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-adcd080d-e6ab-4041-bade-306b9ed9d75c req-8039f08a-b0d8-4792-9ab1-d32c87aef6eb service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:00.088145 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28b587c8-c417-41b0-ac25-d3d787a81003 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:00.089253 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28b587c8-c417-41b0-ac25-d3d787a81003 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:00.089707 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28b587c8-c417-41b0-ac25-d3d787a81003 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:00.090154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-28b587c8-c417-41b0-ac25-d3d787a81003 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:00.102208 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-adcd080d-e6ab-4041-bade-306b9ed9d75c req-8039f08a-b0d8-4792-9ab1-d32c87aef6eb service nova] Creating event network-vif-deleted:94671fa2-8c0f-46c1-8d8a-12ec57a1598d for instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce on hv-cinder-82002 Sep 08 13:57:00.109359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-adcd080d-e6ab-4041-bade-306b9ed9d75c req-8039f08a-b0d8-4792-9ab1-d32c87aef6eb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042192 Sep 08 13:57:00.110705 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 297/587] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:00.161973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-28b587c8-c417-41b0-ac25-d3d787a81003 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:00.171443 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-28b587c8-c417-41b0-ac25-d3d787a81003 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1615 microversion: 2.1 time: 0.097612 Sep 08 13:57:00.172328 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 291/588] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:00 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1615 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:00.346760 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:00.347411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:00.353631 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:00.354142 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:00.354576 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:00.355281 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:00.355734 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:00.356154 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:00.489385 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:00.498152 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:00.499581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:00.500734 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab49a68d-b66c-4a5a-8c52-7588d7769155 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1738 microversion: 2.20 time: 0.158365 Sep 08 13:57:00.501594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 298/589] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:00 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:01.199072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:01.199679 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:01.203747 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:01.207298 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:01.207516 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2c6cd171-b17f-4e73-97da-1f5c459513cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "161ca7c8-30ae-4481-9e2c-fdb8658f2c47"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:01.207999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:01.208192 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:01.208882 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:01.209326 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:01.210859 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:01.211621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2c6cd171-b17f-4e73-97da-1f5c459513cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:01.212291 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=82 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:01.218254 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c6cd171-b17f-4e73-97da-1f5c459513cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:01.218739 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c6cd171-b17f-4e73-97da-1f5c459513cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:01.219238 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c6cd171-b17f-4e73-97da-1f5c459513cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:01.219943 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c6cd171-b17f-4e73-97da-1f5c459513cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:01.220395 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c6cd171-b17f-4e73-97da-1f5c459513cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:01.220816 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2c6cd171-b17f-4e73-97da-1f5c459513cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:01.241984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:01.242459 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:01.242884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:01.243325 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lazy-loading 'fault' on Instance uuid c6a4b8e4-4292-4db0-89b6-b09f84f513ce {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:57:01.287249 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:01.294918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5c61f99f-8cc8-4c14-8cb6-3084e3b71a88 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1332 microversion: 2.1 time: 0.099777 Sep 08 13:57:01.295469 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 292/590] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:01 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:01.529443 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:01.530007 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:01.535964 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:01.536441 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:01.536872 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:01.537587 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:01.538069 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:01.538495 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:01.668857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:01.676973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:01.678456 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:01.679599 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-47827591-19a6-4c54-8c23-4a07aaedadfe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1720 microversion: 2.20 time: 0.155305 Sep 08 13:57:01.680152 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 293/591] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:01 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:02.318385 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:02.318998 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:02.325265 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:02.326273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:02.326731 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:02.327420 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:02.327873 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:02.328293 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:02.359211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:02.359684 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:02.360121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:02.360572 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lazy-loading 'fault' on Instance uuid c6a4b8e4-4292-4db0-89b6-b09f84f513ce {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:57:02.402080 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:02.409816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-427b68c4-1eea-468d-bd6a-b63faad8c72b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1332 microversion: 2.1 time: 0.095350 Sep 08 13:57:02.410418 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 294/592] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:02 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:02.705352 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:02.705994 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:02.711959 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:02.712438 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:02.712875 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:02.713557 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:02.714286 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:02.714706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:02.843874 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:02.851835 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:02.853263 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:02.854444 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b95f3c35-9d41-4096-93fc-c4540cc2c7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1720 microversion: 2.20 time: 0.153464 Sep 08 13:57:02.855004 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 295/593] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:02 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:03.432660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:03.433288 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:03.439657 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:03.440139 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:03.440572 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:03.441256 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:03.441707 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:03.442150 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:03.472389 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:03.472855 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:03.473286 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:03.473722 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lazy-loading 'fault' on Instance uuid c6a4b8e4-4292-4db0-89b6-b09f84f513ce {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:57:03.515854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:03.523438 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ede41578-4f47-4468-bb96-e70812c20f7c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1332 microversion: 2.1 time: 0.094578 Sep 08 13:57:03.524027 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 296/594] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:03 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:03.878779 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:03.879321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:03.885480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:03.885993 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:03.886424 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:03.887112 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:03.887563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:03.888516 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:03.892448 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:04.020394 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:04.029232 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:04.030734 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:04.031893 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5cd99ae9-4d6a-46be-812f-8a5814f06455 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1720 microversion: 2.20 time: 0.157037 Sep 08 13:57:04.032463 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 297/595] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:03 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:04.546394 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:04.547009 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:04.553774 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:04.554187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:04.554703 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:04.555411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:04.556347 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:04.556347 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:04.587433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:04.588115 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:04.588570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:04.589272 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lazy-loading 'fault' on Instance uuid c6a4b8e4-4292-4db0-89b6-b09f84f513ce {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:57:04.614707 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2c6cd171-b17f-4e73-97da-1f5c459513cc tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "POST /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.411465 Sep 08 13:57:04.616080 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 299/596] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 13:57:01 2022] POST /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments => generated 194 bytes in 3414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:57:04.630780 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:04.639037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-32b6d2c1-73c3-4a9d-af17-ca4a6215f23b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1332 microversion: 2.1 time: 0.096476 Sep 08 13:57:04.639604 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 298/597] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:04 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:04.657827 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4504d820-0181-4591-bdf2-e154d1f3f2e7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:04.658463 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4504d820-0181-4591-bdf2-e154d1f3f2e7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:04.664828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4504d820-0181-4591-bdf2-e154d1f3f2e7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:04.665233 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4504d820-0181-4591-bdf2-e154d1f3f2e7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:04.665725 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4504d820-0181-4591-bdf2-e154d1f3f2e7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:04.666436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4504d820-0181-4591-bdf2-e154d1f3f2e7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:04.666877 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4504d820-0181-4591-bdf2-e154d1f3f2e7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:04.667290 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4504d820-0181-4591-bdf2-e154d1f3f2e7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:04.747674 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-4504d820-0181-4591-bdf2-e154d1f3f2e7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lazy-loading 'services' on Instance uuid d2ad7906-3b73-4fc9-a692-9692fb6234b3 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:57:04.805773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-c8bc6298-4a53-45d8-bff1-86ea79c4fb28 req-99eb6b85-db7b-4857-9260-a4137dc7a15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdb4c65-ed8d-4792-ac96-8b1053b167b5", "name": "network-vif-unplugged", "status": "completed", "tag": "c9da782b-975b-4d78-bc93-092cf58fcf3a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:04.816347 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c8bc6298-4a53-45d8-bff1-86ea79c4fb28 req-99eb6b85-db7b-4857-9260-a4137dc7a15b service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:04.816823 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c8bc6298-4a53-45d8-bff1-86ea79c4fb28 req-99eb6b85-db7b-4857-9260-a4137dc7a15b service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:04.817249 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-c8bc6298-4a53-45d8-bff1-86ea79c4fb28 req-99eb6b85-db7b-4857-9260-a4137dc7a15b service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:04.840066 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4504d820-0181-4591-bdf2-e154d1f3f2e7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/os-volume_attachments/119f783b-ae2d-45b1-9631-5751172f3eb8" status: 202 len: 0 microversion: 2.1 time: 0.187520 Sep 08 13:57:04.841789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-c8bc6298-4a53-45d8-bff1-86ea79c4fb28 req-99eb6b85-db7b-4857-9260-a4137dc7a15b service nova] Creating event network-vif-unplugged:c9da782b-975b-4d78-bc93-092cf58fcf3a for instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 on hv-cinder-82002 Sep 08 13:57:04.841951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 300/598] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 13:57:04 2022] DELETE /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/os-volume_attachments/119f783b-ae2d-45b1-9631-5751172f3eb8 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:57:04.847751 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-c8bc6298-4a53-45d8-bff1-86ea79c4fb28 req-99eb6b85-db7b-4857-9260-a4137dc7a15b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045834 Sep 08 13:57:04.848483 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 299/599] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:57:05.057768 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:05.058753 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:05.065537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:05.066256 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:05.066682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:05.067589 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:05.068272 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:05.068757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:05.257178 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:05.265473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:05.267049 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:05.268365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4e50dc47-0bcb-4736-b52a-c248d63fde83 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1720 microversion: 2.20 time: 0.215548 Sep 08 13:57:05.268925 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 301/600] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:05 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:05.662318 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:05.663043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:05.669169 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:05.669823 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:05.670264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:05.670948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:05.671395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:05.671813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:05.703086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:05.703565 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:05.703994 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:05.704435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lazy-loading 'fault' on Instance uuid c6a4b8e4-4292-4db0-89b6-b09f84f513ce {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:57:05.745418 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:05.753760 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-40179493-d354-47a7-9ea6-1bdec35c2a1c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 200 len: 1332 microversion: 2.1 time: 0.096266 Sep 08 13:57:05.754350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 300/601] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:05 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:06.293657 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:06.294344 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:06.300644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:06.301123 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:06.301554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:06.302278 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:06.302734 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:06.303155 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:06.439479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:06.448081 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:06.449584 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:06.451528 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-613176ec-dd3d-4a06-89d8-1dd90b4c12e7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1720 microversion: 2.20 time: 0.161707 Sep 08 13:57:06.461755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 302/602] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:06 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:06.778884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:06.779593 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:06.786293 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:06.786778 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:06.787211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:06.787965 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:06.788420 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:06.788841 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:06.803464 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce HTTP/1.1 Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:57:06.805228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 13:57:06.806765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': 'c6a4b8e4-4292-4db0-89b6-b09f84f513ce'} Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:57:06.807574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 13:57:06.808793 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:57:06.811673 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:57:06.811673 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37740fd2-c61c-4ea6-9c2f-b2bf0682d84b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 404 len: 111 microversion: 2.1 time: 0.032313 Sep 08 13:57:06.811673 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 301/603] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:06 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:57:06.816759 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d016ca55-d19d-4585-b9a2-9f5c9d2a516f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '.version_select at 0x7f5be43560d0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:06.835833 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d016ca55-d19d-4585-b9a2-9f5c9d2a516f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559639221" status: 202 len: 0 microversion: 2.1 time: 0.023042 Sep 08 13:57:06.836384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 303/604] 10.222.0.55 () {58 vars in 1221 bytes} [Thu Sep 8 13:57:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559639221 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:57:07.454743 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8aa9bd59-5462-42e3-9677-ea3ed10aa14b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: .version_select at 0x7f5be44f1b80>, body: {"keypair": {"name": "tempest-keypair-259129649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeq0Zi/i7BLSK2EwTXJT7hGJB+A7VnnZHBnFrUU23aTXVBaLT0JYbjxHONsgXLkEts5sxKd7kmNpzwnUmqcUO/QnZz4o0g1gsWeBrWIgHqjAe39dcB0EhG/0Q4Jz1V+Nw=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:07.470102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-8aa9bd59-5462-42e3-9677-ea3ed10aa14b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for project b4ca185497284e9780eba8fc2e713d6e. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:57:07.475993 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-8aa9bd59-5462-42e3-9677-ea3ed10aa14b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for user 2e48a8c1b91142cf9d1af17f28e41961 and project b4ca185497284e9780eba8fc2e713d6e. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:57:07.478969 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:07.480251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:07.495028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:07.495597 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:07.496094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:07.497017 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:07.497568 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:07.498097 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:07.507423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8aa9bd59-5462-42e3-9677-ea3ed10aa14b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059044 Sep 08 13:57:07.508182 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 302/605] 10.222.0.55 () {60 vars in 1159 bytes} [Thu Sep 8 13:57:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:07.690559 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:07.698742 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:07.700193 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:07.701914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fca6401a-c593-4edb-a0e7-979dbc8abc86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1720 microversion: 2.20 time: 0.227044 Sep 08 13:57:07.702468 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 304/606] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:07 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:08.729180 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:08.729954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:08.742150 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:08.742862 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:08.743460 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:08.744381 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:08.745065 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:08.745584 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:08.982696 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:08.991127 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:08.992701 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:08.993948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f2850bf3-8604-4dc7-a847-53ce1d366f3c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1723 microversion: 2.20 time: 0.269305 Sep 08 13:57:08.994518 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 303/607] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:08 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:09.020257 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cd98e25f-8ee9-4346-9896-1f20dd9e0efe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ea4892f-6042-4852-a87a-29440ff5ee57"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:09.022939 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cd98e25f-8ee9-4346-9896-1f20dd9e0efe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:09.030283 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd98e25f-8ee9-4346-9896-1f20dd9e0efe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:09.030754 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd98e25f-8ee9-4346-9896-1f20dd9e0efe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:09.031383 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd98e25f-8ee9-4346-9896-1f20dd9e0efe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:09.032069 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd98e25f-8ee9-4346-9896-1f20dd9e0efe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:09.032669 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd98e25f-8ee9-4346-9896-1f20dd9e0efe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:09.033127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cd98e25f-8ee9-4346-9896-1f20dd9e0efe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:09.195781 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-012a677e-4b1f-4e17-994a-ead43d695997 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:09.214384 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-012a677e-4b1f-4e17-994a-ead43d695997 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:09.219396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-012a677e-4b1f-4e17-994a-ead43d695997 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:09.219964 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-012a677e-4b1f-4e17-994a-ead43d695997 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:09.258809 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-012a677e-4b1f-4e17-994a-ead43d695997 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Going to try to stop instance {{(pid=126920) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 13:57:09.305335 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-012a677e-4b1f-4e17-994a-ead43d695997 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "POST /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/action" status: 202 len: 0 microversion: 2.1 time: 0.115531 Sep 08 13:57:09.306050 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 304/608] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:57:09 2022] POST /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:57:09.313294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-709326977", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf5901ef-2ee5-4879-85aa-18770c77b80a"}], "security_groups": [{"name": "tempest-securitygroup--581573324"}], "key_name": "tempest-keypair-259129649", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:09.381678 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cd98e25f-8ee9-4346-9896-1f20dd9e0efe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "POST /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.365422 Sep 08 13:57:09.382335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 305/609] 10.222.0.55 () {62 vars in 1364 bytes} [Thu Sep 8 13:57:09 2022] POST /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments => generated 188 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:57:09.392654 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0caa6ba8-02eb-4361-b238-e0ee06980547 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:09.393276 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0caa6ba8-02eb-4361-b238-e0ee06980547 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:09.399862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0caa6ba8-02eb-4361-b238-e0ee06980547 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:09.400283 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0caa6ba8-02eb-4361-b238-e0ee06980547 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:09.400883 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0caa6ba8-02eb-4361-b238-e0ee06980547 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:09.401582 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0caa6ba8-02eb-4361-b238-e0ee06980547 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:09.402235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0caa6ba8-02eb-4361-b238-e0ee06980547 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:09.402823 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0caa6ba8-02eb-4361-b238-e0ee06980547 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:09.431568 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] validate_networks() for [('cf5901ef-2ee5-4879-85aa-18770c77b80a', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:57:09.625293 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0caa6ba8-02eb-4361-b238-e0ee06980547 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:09.633898 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0caa6ba8-02eb-4361-b238-e0ee06980547 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.245051 Sep 08 13:57:09.634568 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 306/610] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:09 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:09.645986 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d2421dc2-2a7e-487a-b729-72763c6c3354 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:09.645986 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d2421dc2-2a7e-487a-b729-72763c6c3354 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:09.646299 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2421dc2-2a7e-487a-b729-72763c6c3354 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:09.646494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2421dc2-2a7e-487a-b729-72763c6c3354 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:09.647119 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2421dc2-2a7e-487a-b729-72763c6c3354 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:09.647967 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2421dc2-2a7e-487a-b729-72763c6c3354 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:09.648574 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2421dc2-2a7e-487a-b729-72763c6c3354 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:09.649157 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2421dc2-2a7e-487a-b729-72763c6c3354 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:09.696289 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d2421dc2-2a7e-487a-b729-72763c6c3354 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126919) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 13:57:09.731339 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:09.772481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d2421dc2-2a7e-487a-b729-72763c6c3354 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "POST /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/action" status: 202 len: 0 microversion: 2.20 time: 0.136770 Sep 08 13:57:09.773292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 307/611] 10.222.0.55 () {62 vars in 1319 bytes} [Thu Sep 8 13:57:09 2022] POST /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:57:09.782487 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:09.783096 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:09.798594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:09.799328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:09.800827 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:09.801695 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:09.802245 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:09.802670 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:10.002657 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:57:10.003086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:57:10.003529 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:57:10.003934 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:57:10.004379 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:57:10.015206 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:10.016036 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:10.016474 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:10.017199 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:10.017643 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:10.018331 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:10.029835 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:10.036769 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for project b4ca185497284e9780eba8fc2e713d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:57:10.039068 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:10.040491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:10.040966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for user 2e48a8c1b91142cf9d1af17f28e41961 and project b4ca185497284e9780eba8fc2e713d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:57:10.041801 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e029a489-4c97-45f0-9a3c-f2324688fd64 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1749 microversion: 2.20 time: 0.263903 Sep 08 13:57:10.042668 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 308/612] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:09 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1749 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:10.052840 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:57:10.055340 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:57:10.104005 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e0e3f4cd-2a7d-42c9-a311-de28bda8a79d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.796460 Sep 08 13:57:10.104656 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 305/613] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:57:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:57:10.116481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e39ab418-81e0-4bd4-8a6f-cf74a165c51c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:10.117520 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e39ab418-81e0-4bd4-8a6f-cf74a165c51c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:10.183176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e39ab418-81e0-4bd4-8a6f-cf74a165c51c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:10.192058 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e39ab418-81e0-4bd4-8a6f-cf74a165c51c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1240 microversion: 2.1 time: 0.079910 Sep 08 13:57:10.192973 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 309/614] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:10 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:10.659218 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d0bc374-f08c-41f6-8e0d-8442f9bf9597 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:10.659870 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4d0bc374-f08c-41f6-8e0d-8442f9bf9597 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:10.666864 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d0bc374-f08c-41f6-8e0d-8442f9bf9597 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:10.667352 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d0bc374-f08c-41f6-8e0d-8442f9bf9597 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:10.667824 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d0bc374-f08c-41f6-8e0d-8442f9bf9597 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:10.668553 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d0bc374-f08c-41f6-8e0d-8442f9bf9597 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:10.669595 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d0bc374-f08c-41f6-8e0d-8442f9bf9597 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:10.670035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d0bc374-f08c-41f6-8e0d-8442f9bf9597 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:10.806414 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4d0bc374-f08c-41f6-8e0d-8442f9bf9597 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:10.817200 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d0bc374-f08c-41f6-8e0d-8442f9bf9597 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.162575 Sep 08 13:57:10.818221 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 306/615] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:10 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:11.068023 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:11.068641 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:11.075151 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:11.075768 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:11.076206 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:11.076974 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:11.077462 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:11.077918 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:11.215825 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-59e86a3a-7c11-42b2-9618-4b60ed415eca tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:11.217056 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-59e86a3a-7c11-42b2-9618-4b60ed415eca tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:11.217158 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:11.223086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59e86a3a-7c11-42b2-9618-4b60ed415eca tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:11.223512 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59e86a3a-7c11-42b2-9618-4b60ed415eca tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:11.223944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59e86a3a-7c11-42b2-9618-4b60ed415eca tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:11.224675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59e86a3a-7c11-42b2-9618-4b60ed415eca tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:11.225124 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59e86a3a-7c11-42b2-9618-4b60ed415eca tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:11.225546 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-59e86a3a-7c11-42b2-9618-4b60ed415eca tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:11.225641 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:11.227089 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:11.228228 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0e8c6051-6457-4eb1-a735-286fff299f41 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1751 microversion: 2.20 time: 0.164146 Sep 08 13:57:11.228791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 310/616] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:11 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:11.286011 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-59e86a3a-7c11-42b2-9618-4b60ed415eca tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:11.293787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-59e86a3a-7c11-42b2-9618-4b60ed415eca tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1292 microversion: 2.1 time: 0.082169 Sep 08 13:57:11.294386 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 307/617] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:11 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1292 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:11.842203 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1bd1d70b-5ea4-48ba-90ca-f971d5494d50 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:11.842730 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1bd1d70b-5ea4-48ba-90ca-f971d5494d50 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:11.848667 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bd1d70b-5ea4-48ba-90ca-f971d5494d50 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:11.849153 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bd1d70b-5ea4-48ba-90ca-f971d5494d50 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:11.849587 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bd1d70b-5ea4-48ba-90ca-f971d5494d50 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:11.850334 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bd1d70b-5ea4-48ba-90ca-f971d5494d50 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:11.850789 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bd1d70b-5ea4-48ba-90ca-f971d5494d50 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:11.851206 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1bd1d70b-5ea4-48ba-90ca-f971d5494d50 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:12.036340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-1bd1d70b-5ea4-48ba-90ca-f971d5494d50 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:12.043908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1bd1d70b-5ea4-48ba-90ca-f971d5494d50 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.207292 Sep 08 13:57:12.045106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 311/618] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:11 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:12.253067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:12.253773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:12.260587 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:12.261075 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:12.261513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:12.262305 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:12.262848 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:12.263300 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:12.316864 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22878464-6d22-4457-aa26-f8eeb9571834 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:12.317469 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22878464-6d22-4457-aa26-f8eeb9571834 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:12.325075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22878464-6d22-4457-aa26-f8eeb9571834 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:12.326531 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22878464-6d22-4457-aa26-f8eeb9571834 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:12.328588 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22878464-6d22-4457-aa26-f8eeb9571834 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:12.329496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22878464-6d22-4457-aa26-f8eeb9571834 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:12.330061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22878464-6d22-4457-aa26-f8eeb9571834 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:12.330570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22878464-6d22-4457-aa26-f8eeb9571834 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:12.427140 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-22878464-6d22-4457-aa26-f8eeb9571834 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:12.434985 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-22878464-6d22-4457-aa26-f8eeb9571834 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1298 microversion: 2.1 time: 0.121829 Sep 08 13:57:12.435594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 312/619] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:12 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:12.478043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:12.487912 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:12.489354 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:12.490546 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7a0aebd0-0141-4329-92fc-b0e95f59f7a3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1751 microversion: 2.20 time: 0.241550 Sep 08 13:57:12.491102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 308/620] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:12 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1751 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:13.067193 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ebed8a16-8f62-4bc4-85fb-40e09c71280f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:13.067802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ebed8a16-8f62-4bc4-85fb-40e09c71280f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:13.073751 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebed8a16-8f62-4bc4-85fb-40e09c71280f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:13.074236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebed8a16-8f62-4bc4-85fb-40e09c71280f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:13.074672 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebed8a16-8f62-4bc4-85fb-40e09c71280f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:13.075394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebed8a16-8f62-4bc4-85fb-40e09c71280f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:13.075839 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebed8a16-8f62-4bc4-85fb-40e09c71280f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:13.076259 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ebed8a16-8f62-4bc4-85fb-40e09c71280f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:13.291601 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ebed8a16-8f62-4bc4-85fb-40e09c71280f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:13.301493 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ebed8a16-8f62-4bc4-85fb-40e09c71280f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.238096 Sep 08 13:57:13.302753 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 313/621] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:13 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:13.459339 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0a10795a-ed1d-4b4b-ab1c-9441453f3981 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:13.460157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0a10795a-ed1d-4b4b-ab1c-9441453f3981 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:13.468086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a10795a-ed1d-4b4b-ab1c-9441453f3981 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:13.468570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a10795a-ed1d-4b4b-ab1c-9441453f3981 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:13.469001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a10795a-ed1d-4b4b-ab1c-9441453f3981 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:13.469703 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a10795a-ed1d-4b4b-ab1c-9441453f3981 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:13.470205 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a10795a-ed1d-4b4b-ab1c-9441453f3981 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:13.470880 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0a10795a-ed1d-4b4b-ab1c-9441453f3981 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:13.517007 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:13.517607 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:13.525911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:13.526703 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:13.527136 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:13.527836 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:13.528279 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:13.528910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:13.723324 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0a10795a-ed1d-4b4b-ab1c-9441453f3981 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:13.730942 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0a10795a-ed1d-4b4b-ab1c-9441453f3981 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.276892 Sep 08 13:57:13.731517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 309/622] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:13 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:13.777442 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:13.786929 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:13.788536 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:13.789853 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3a3faa66-b011-4ffc-a4c8-e7324ed2609b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1751 microversion: 2.20 time: 0.277266 Sep 08 13:57:13.790522 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 314/623] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:13 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1751 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:13.832298 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-602e5071-de55-4825-9170-73a31f2622f1 req-6eac6bcb-bf88-4440-9660-19c29ad5058d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b6fbb8-a2c9-4c92-b120-8ea3259c9b56", "tag": "c57d5f48-246f-41c1-903a-f9a3fa47d52b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:13.841961 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-602e5071-de55-4825-9170-73a31f2622f1 req-6eac6bcb-bf88-4440-9660-19c29ad5058d service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:13.842433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-602e5071-de55-4825-9170-73a31f2622f1 req-6eac6bcb-bf88-4440-9660-19c29ad5058d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:13.842858 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-602e5071-de55-4825-9170-73a31f2622f1 req-6eac6bcb-bf88-4440-9660-19c29ad5058d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:13.856904 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-602e5071-de55-4825-9170-73a31f2622f1 req-6eac6bcb-bf88-4440-9660-19c29ad5058d service nova] Creating event network-changed:c57d5f48-246f-41c1-903a-f9a3fa47d52b for instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 on hv-cinder-82002 Sep 08 13:57:13.861454 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-602e5071-de55-4825-9170-73a31f2622f1 req-6eac6bcb-bf88-4440-9660-19c29ad5058d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032894 Sep 08 13:57:13.862076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 310/624] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:14.326335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c3aa8aee-eeb9-4e36-b3eb-dd207ad1c95f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:14.326966 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c3aa8aee-eeb9-4e36-b3eb-dd207ad1c95f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:14.332822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3aa8aee-eeb9-4e36-b3eb-dd207ad1c95f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:14.333293 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3aa8aee-eeb9-4e36-b3eb-dd207ad1c95f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:14.333715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3aa8aee-eeb9-4e36-b3eb-dd207ad1c95f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:14.334409 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3aa8aee-eeb9-4e36-b3eb-dd207ad1c95f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:14.334862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3aa8aee-eeb9-4e36-b3eb-dd207ad1c95f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:14.335277 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3aa8aee-eeb9-4e36-b3eb-dd207ad1c95f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:14.466620 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3aa8aee-eeb9-4e36-b3eb-dd207ad1c95f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:14.474260 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c3aa8aee-eeb9-4e36-b3eb-dd207ad1c95f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.151919 Sep 08 13:57:14.474826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 315/625] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:14 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:14.755283 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3eb55cdf-b4bf-4be4-b382-fc1ff15def49 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:14.756118 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3eb55cdf-b4bf-4be4-b382-fc1ff15def49 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:14.763506 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eb55cdf-b4bf-4be4-b382-fc1ff15def49 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:14.763993 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eb55cdf-b4bf-4be4-b382-fc1ff15def49 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:14.764422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eb55cdf-b4bf-4be4-b382-fc1ff15def49 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:14.765115 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eb55cdf-b4bf-4be4-b382-fc1ff15def49 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:14.765566 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eb55cdf-b4bf-4be4-b382-fc1ff15def49 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:14.766010 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eb55cdf-b4bf-4be4-b382-fc1ff15def49 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:14.817903 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:14.818537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:14.825009 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:14.826008 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:14.826438 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:14.827229 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:14.827675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:14.828142 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:15.024590 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3eb55cdf-b4bf-4be4-b382-fc1ff15def49 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:15.032042 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3eb55cdf-b4bf-4be4-b382-fc1ff15def49 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.281273 Sep 08 13:57:15.032648 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 311/626] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:14 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:15.107522 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:15.116063 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:15.117498 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:15.118685 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cb327b56-c847-42ad-aef7-173f89c55009 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1751 microversion: 2.20 time: 0.304723 Sep 08 13:57:15.119246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 316/627] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:14 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1751 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:15.497552 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7d0a21d7-8d65-4375-9e90-10c5bf6d9b8b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:15.498322 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d0a21d7-8d65-4375-9e90-10c5bf6d9b8b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:15.504312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d0a21d7-8d65-4375-9e90-10c5bf6d9b8b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:15.504911 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d0a21d7-8d65-4375-9e90-10c5bf6d9b8b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:15.505425 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d0a21d7-8d65-4375-9e90-10c5bf6d9b8b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:15.506236 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d0a21d7-8d65-4375-9e90-10c5bf6d9b8b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:15.506697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d0a21d7-8d65-4375-9e90-10c5bf6d9b8b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:15.507126 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d0a21d7-8d65-4375-9e90-10c5bf6d9b8b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:15.645656 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7d0a21d7-8d65-4375-9e90-10c5bf6d9b8b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:15.654593 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7d0a21d7-8d65-4375-9e90-10c5bf6d9b8b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.160829 Sep 08 13:57:15.655175 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 312/628] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:15 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:16.055199 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee3bead3-74f9-4618-a316-1483b21ebda3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:16.055813 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee3bead3-74f9-4618-a316-1483b21ebda3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:16.062938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3bead3-74f9-4618-a316-1483b21ebda3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:16.063356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3bead3-74f9-4618-a316-1483b21ebda3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:16.063789 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3bead3-74f9-4618-a316-1483b21ebda3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:16.064482 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3bead3-74f9-4618-a316-1483b21ebda3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:16.064933 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3bead3-74f9-4618-a316-1483b21ebda3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:16.065350 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee3bead3-74f9-4618-a316-1483b21ebda3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:16.145458 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:16.146234 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:16.153688 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:16.154250 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:16.154685 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:16.155739 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:16.156190 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:16.156615 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:16.216911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee3bead3-74f9-4618-a316-1483b21ebda3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:16.224525 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee3bead3-74f9-4618-a316-1483b21ebda3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.173239 Sep 08 13:57:16.226888 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 317/629] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:16 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:16.306175 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:16.334343 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:16.335914 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:16.337161 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ba8ff910-6605-4b64-888b-20da0eab841f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1751 microversion: 2.20 time: 0.195858 Sep 08 13:57:16.338103 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 313/630] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:16 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:16.678858 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-04dd73a7-e4a2-4f5c-9562-6455dbff73f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:16.679795 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-04dd73a7-e4a2-4f5c-9562-6455dbff73f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:16.687005 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04dd73a7-e4a2-4f5c-9562-6455dbff73f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:16.687592 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04dd73a7-e4a2-4f5c-9562-6455dbff73f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:16.688310 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04dd73a7-e4a2-4f5c-9562-6455dbff73f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:16.689023 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04dd73a7-e4a2-4f5c-9562-6455dbff73f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:16.689610 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04dd73a7-e4a2-4f5c-9562-6455dbff73f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:16.690063 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04dd73a7-e4a2-4f5c-9562-6455dbff73f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:16.980859 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-04dd73a7-e4a2-4f5c-9562-6455dbff73f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:16.991489 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-04dd73a7-e4a2-4f5c-9562-6455dbff73f6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.316848 Sep 08 13:57:17.003331 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 318/631] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:16 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:17.247965 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5bec0e3c-ca97-4c88-91db-5741a0b25164 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:17.248567 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5bec0e3c-ca97-4c88-91db-5741a0b25164 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:17.254924 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bec0e3c-ca97-4c88-91db-5741a0b25164 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:17.255505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bec0e3c-ca97-4c88-91db-5741a0b25164 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:17.255955 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bec0e3c-ca97-4c88-91db-5741a0b25164 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:17.256640 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bec0e3c-ca97-4c88-91db-5741a0b25164 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:17.257082 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bec0e3c-ca97-4c88-91db-5741a0b25164 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:17.257535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5bec0e3c-ca97-4c88-91db-5741a0b25164 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:17.362786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:17.363475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:17.369850 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:17.370325 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:17.370749 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:17.371466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:17.371913 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:17.372329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:17.521495 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5bec0e3c-ca97-4c88-91db-5741a0b25164 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:17.537286 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5bec0e3c-ca97-4c88-91db-5741a0b25164 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.292927 Sep 08 13:57:17.542535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 314/632] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:17 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:17.576290 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9aa8f96a-8288-4164-9096-af9d1d6be4cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:17.580661 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9aa8f96a-8288-4164-9096-af9d1d6be4cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:17.589896 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa8f96a-8288-4164-9096-af9d1d6be4cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:17.590497 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa8f96a-8288-4164-9096-af9d1d6be4cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:17.591225 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa8f96a-8288-4164-9096-af9d1d6be4cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:17.592062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa8f96a-8288-4164-9096-af9d1d6be4cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:17.592836 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa8f96a-8288-4164-9096-af9d1d6be4cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:17.593447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9aa8f96a-8288-4164-9096-af9d1d6be4cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:17.614262 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:17.623160 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-9aa8f96a-8288-4164-9096-af9d1d6be4cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lazy-loading 'flavor' on Instance uuid 21bead64-8c72-4cb8-806b-f68b2fc593cc {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:57:17.627991 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:17.634092 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:17.635622 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:17.640311 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3e83220d-01c2-4c81-b357-4de2f51cf592 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1751 microversion: 2.20 time: 0.277928 Sep 08 13:57:17.657867 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 319/633] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:17 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1751 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:17.787777 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9aa8f96a-8288-4164-9096-af9d1d6be4cb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "POST /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/action" status: 200 len: 32 microversion: 2.1 time: 0.231746 Sep 08 13:57:17.788490 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 315/634] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:57:17 2022] POST /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:57:17.798207 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-947899b9-6793-4809-a9b9-0c8ffdc3f7d7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:17.799384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-947899b9-6793-4809-a9b9-0c8ffdc3f7d7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:17.812539 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-947899b9-6793-4809-a9b9-0c8ffdc3f7d7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:17.814443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-947899b9-6793-4809-a9b9-0c8ffdc3f7d7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:17.814992 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-947899b9-6793-4809-a9b9-0c8ffdc3f7d7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:17.816394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-947899b9-6793-4809-a9b9-0c8ffdc3f7d7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:17.816943 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-947899b9-6793-4809-a9b9-0c8ffdc3f7d7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:17.818051 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-947899b9-6793-4809-a9b9-0c8ffdc3f7d7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:18.017351 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eeaabb93-1cc3-448a-9297-911a13b78d2a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:18.018028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eeaabb93-1cc3-448a-9297-911a13b78d2a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:18.025145 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeaabb93-1cc3-448a-9297-911a13b78d2a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:18.025911 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeaabb93-1cc3-448a-9297-911a13b78d2a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:18.026503 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeaabb93-1cc3-448a-9297-911a13b78d2a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:18.027379 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeaabb93-1cc3-448a-9297-911a13b78d2a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:18.028017 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeaabb93-1cc3-448a-9297-911a13b78d2a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:18.028644 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eeaabb93-1cc3-448a-9297-911a13b78d2a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:18.286164 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-947899b9-6793-4809-a9b9-0c8ffdc3f7d7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:18.297019 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-947899b9-6793-4809-a9b9-0c8ffdc3f7d7 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.502840 Sep 08 13:57:18.298149 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 320/635] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:17 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:18.378813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-eeaabb93-1cc3-448a-9297-911a13b78d2a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:18.388072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eeaabb93-1cc3-448a-9297-911a13b78d2a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.375266 Sep 08 13:57:18.388730 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 316/636] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:18 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:18.568950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-10a5634a-57f8-4bf4-b525-f322e2a10d9c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:18.570411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-10a5634a-57f8-4bf4-b525-f322e2a10d9c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:18.584994 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a5634a-57f8-4bf4-b525-f322e2a10d9c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:18.585475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a5634a-57f8-4bf4-b525-f322e2a10d9c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:18.586130 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a5634a-57f8-4bf4-b525-f322e2a10d9c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:18.586818 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a5634a-57f8-4bf4-b525-f322e2a10d9c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:18.587408 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a5634a-57f8-4bf4-b525-f322e2a10d9c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:18.588009 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10a5634a-57f8-4bf4-b525-f322e2a10d9c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:18.666405 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:18.667413 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:18.676689 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:18.678189 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:18.678871 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:18.679839 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:18.680551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:18.681191 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:19.104419 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-10a5634a-57f8-4bf4-b525-f322e2a10d9c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:19.112931 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-10a5634a-57f8-4bf4-b525-f322e2a10d9c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.550784 Sep 08 13:57:19.113595 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 321/637] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:18 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:19.159709 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:19.168492 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:19.169989 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:19.171151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bbcc1090-5523-4361-be41-3d24d6be79de tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.508643 Sep 08 13:57:19.172227 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 317/638] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:18 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:19.320618 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d60502d2-73d2-416e-9388-45c8fc3a291b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:19.321605 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d60502d2-73d2-416e-9388-45c8fc3a291b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:19.328358 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d60502d2-73d2-416e-9388-45c8fc3a291b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:19.329329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d60502d2-73d2-416e-9388-45c8fc3a291b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:19.330284 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d60502d2-73d2-416e-9388-45c8fc3a291b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:19.331718 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d60502d2-73d2-416e-9388-45c8fc3a291b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:19.334030 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d60502d2-73d2-416e-9388-45c8fc3a291b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:19.334866 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d60502d2-73d2-416e-9388-45c8fc3a291b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:19.412861 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-044a20d2-342c-4374-8802-9f67091a7781 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:19.413643 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-044a20d2-342c-4374-8802-9f67091a7781 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:19.420887 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-044a20d2-342c-4374-8802-9f67091a7781 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:19.421514 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-044a20d2-342c-4374-8802-9f67091a7781 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:19.422059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-044a20d2-342c-4374-8802-9f67091a7781 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:19.422849 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-044a20d2-342c-4374-8802-9f67091a7781 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:19.423371 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-044a20d2-342c-4374-8802-9f67091a7781 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:19.423859 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-044a20d2-342c-4374-8802-9f67091a7781 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:20.028748 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:20.047985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=10 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:20.133327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-044a20d2-342c-4374-8802-9f67091a7781 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:20.142264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-044a20d2-342c-4374-8802-9f67091a7781 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.733342 Sep 08 13:57:20.143086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 318/639] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:19 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:20.147743 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-04222b08-3fcf-4236-bacd-ac5aee5efee1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:20.148423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-04222b08-3fcf-4236-bacd-ac5aee5efee1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:20.154848 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04222b08-3fcf-4236-bacd-ac5aee5efee1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:20.155569 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04222b08-3fcf-4236-bacd-ac5aee5efee1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:20.156222 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04222b08-3fcf-4236-bacd-ac5aee5efee1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:20.157519 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d60502d2-73d2-416e-9388-45c8fc3a291b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:20.158336 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04222b08-3fcf-4236-bacd-ac5aee5efee1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:20.159015 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04222b08-3fcf-4236-bacd-ac5aee5efee1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:20.159654 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-04222b08-3fcf-4236-bacd-ac5aee5efee1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:20.170917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d60502d2-73d2-416e-9388-45c8fc3a291b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.854230 Sep 08 13:57:20.171507 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 322/640] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:19 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:20.197829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:20.198439 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:20.200765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:20.207349 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:20.207924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:20.208432 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:20.209210 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:20.209770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:20.210355 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:20.598940 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-04222b08-3fcf-4236-bacd-ac5aee5efee1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:20.608129 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:20.609222 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-04222b08-3fcf-4236-bacd-ac5aee5efee1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.464685 Sep 08 13:57:20.610424 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 319/641] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:20 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:20.623858 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:20.625772 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:20.627493 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2ebb6a10-621b-457e-8a40-5092f346a60c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.433332 Sep 08 13:57:20.628227 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 323/642] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:20 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:20.662369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-7d5d0be7-0795-4e8d-be85-9dc69452d5c0 req-8d6b25d2-4f3f-492c-99d4-64d541bf7ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b6fbb8-a2c9-4c92-b120-8ea3259c9b56", "name": "network-vif-plugged", "status": "completed", "tag": "c57d5f48-246f-41c1-903a-f9a3fa47d52b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:20.674160 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7d5d0be7-0795-4e8d-be85-9dc69452d5c0 req-8d6b25d2-4f3f-492c-99d4-64d541bf7ee5 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:20.675316 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7d5d0be7-0795-4e8d-be85-9dc69452d5c0 req-8d6b25d2-4f3f-492c-99d4-64d541bf7ee5 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:20.675855 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-7d5d0be7-0795-4e8d-be85-9dc69452d5c0 req-8d6b25d2-4f3f-492c-99d4-64d541bf7ee5 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:20.691153 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-7d5d0be7-0795-4e8d-be85-9dc69452d5c0 req-8d6b25d2-4f3f-492c-99d4-64d541bf7ee5 service nova] Creating event network-vif-plugged:c57d5f48-246f-41c1-903a-f9a3fa47d52b for instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 on hv-cinder-82002 Sep 08 13:57:20.698299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-7d5d0be7-0795-4e8d-be85-9dc69452d5c0 req-8d6b25d2-4f3f-492c-99d4-64d541bf7ee5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039268 Sep 08 13:57:20.700842 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 320/643] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:21.169824 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3fe80107-239e-4176-8e87-823eec294cf1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:21.171684 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3fe80107-239e-4176-8e87-823eec294cf1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:21.177773 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe80107-239e-4176-8e87-823eec294cf1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:21.178523 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe80107-239e-4176-8e87-823eec294cf1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:21.179142 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe80107-239e-4176-8e87-823eec294cf1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:21.180065 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe80107-239e-4176-8e87-823eec294cf1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:21.180670 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe80107-239e-4176-8e87-823eec294cf1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:21.181414 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3fe80107-239e-4176-8e87-823eec294cf1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:21.198199 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4f78bd6b-16d5-451a-bcbf-5033a42b1443 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:21.199054 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4f78bd6b-16d5-451a-bcbf-5033a42b1443 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:21.206615 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:21.206868 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f78bd6b-16d5-451a-bcbf-5033a42b1443 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:21.207560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f78bd6b-16d5-451a-bcbf-5033a42b1443 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:21.208165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f78bd6b-16d5-451a-bcbf-5033a42b1443 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:21.209365 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f78bd6b-16d5-451a-bcbf-5033a42b1443 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:21.210587 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f78bd6b-16d5-451a-bcbf-5033a42b1443 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:21.211275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4f78bd6b-16d5-451a-bcbf-5033a42b1443 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:21.524359 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4f78bd6b-16d5-451a-bcbf-5033a42b1443 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:21.542176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3fe80107-239e-4176-8e87-823eec294cf1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:21.549884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4f78bd6b-16d5-451a-bcbf-5033a42b1443 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.357203 Sep 08 13:57:21.564403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3fe80107-239e-4176-8e87-823eec294cf1 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.400482 Sep 08 13:57:21.576667 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 324/644] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:21 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:21.577518 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 321/645] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:21 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:21.637364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d6e6bf22-6127-46aa-933c-a9ea7167b745 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:21.638106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d6e6bf22-6127-46aa-933c-a9ea7167b745 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:21.652352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e6bf22-6127-46aa-933c-a9ea7167b745 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:21.652856 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e6bf22-6127-46aa-933c-a9ea7167b745 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:21.654193 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:21.655625 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:21.661262 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e6bf22-6127-46aa-933c-a9ea7167b745 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:21.662259 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e6bf22-6127-46aa-933c-a9ea7167b745 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:21.662775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e6bf22-6127-46aa-933c-a9ea7167b745 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:21.663209 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6e6bf22-6127-46aa-933c-a9ea7167b745 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:21.668288 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:21.670433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:21.671122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:21.674514 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:21.676221 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:21.676906 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:22.323843 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d6e6bf22-6127-46aa-933c-a9ea7167b745 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:22.344217 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d6e6bf22-6127-46aa-933c-a9ea7167b745 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.713981 Sep 08 13:57:22.345704 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 325/646] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:21 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:22.390980 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:22.402636 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:22.406728 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:22.408126 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f05fe83-5b9b-464e-9ecd-1b0040e1e649 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.758981 Sep 08 13:57:22.408695 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 322/647] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:21 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:22.588572 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-706677d1-b4b5-4cd5-b2e3-caf5caaf5c07 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:22.589479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-706677d1-b4b5-4cd5-b2e3-caf5caaf5c07 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:22.594194 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-24db78c5-b65e-424b-a849-9d77f314ff18 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:22.595285 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-24db78c5-b65e-424b-a849-9d77f314ff18 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:22.605125 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-706677d1-b4b5-4cd5-b2e3-caf5caaf5c07 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:22.606069 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-706677d1-b4b5-4cd5-b2e3-caf5caaf5c07 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:22.607257 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-706677d1-b4b5-4cd5-b2e3-caf5caaf5c07 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:22.608268 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-706677d1-b4b5-4cd5-b2e3-caf5caaf5c07 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:22.608928 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-706677d1-b4b5-4cd5-b2e3-caf5caaf5c07 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:22.609555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-706677d1-b4b5-4cd5-b2e3-caf5caaf5c07 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:22.617011 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24db78c5-b65e-424b-a849-9d77f314ff18 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:22.617836 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24db78c5-b65e-424b-a849-9d77f314ff18 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:22.618453 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24db78c5-b65e-424b-a849-9d77f314ff18 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:22.621237 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24db78c5-b65e-424b-a849-9d77f314ff18 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:22.625411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24db78c5-b65e-424b-a849-9d77f314ff18 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:22.626129 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-24db78c5-b65e-424b-a849-9d77f314ff18 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:22.939015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-706677d1-b4b5-4cd5-b2e3-caf5caaf5c07 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:22.951790 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-706677d1-b4b5-4cd5-b2e3-caf5caaf5c07 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.366905 Sep 08 13:57:22.952393 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 326/648] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:22 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:22.969912 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-24db78c5-b65e-424b-a849-9d77f314ff18 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:22.985138 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-24db78c5-b65e-424b-a849-9d77f314ff18 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.398251 Sep 08 13:57:22.986076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 323/649] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:22 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:23.368441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-04eb7f80-0f07-4563-b71a-ebb0df3b9dda tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:23.369054 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-04eb7f80-0f07-4563-b71a-ebb0df3b9dda tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:23.375709 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04eb7f80-0f07-4563-b71a-ebb0df3b9dda tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:23.376200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04eb7f80-0f07-4563-b71a-ebb0df3b9dda tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:23.376909 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04eb7f80-0f07-4563-b71a-ebb0df3b9dda tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:23.377885 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04eb7f80-0f07-4563-b71a-ebb0df3b9dda tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:23.382648 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04eb7f80-0f07-4563-b71a-ebb0df3b9dda tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:23.383382 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-04eb7f80-0f07-4563-b71a-ebb0df3b9dda tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:23.439351 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:23.439966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:23.458757 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:23.464739 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:23.482806 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:23.483263 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:23.484016 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:23.484479 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:23.484905 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:23.881320 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:23.901833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:23.907518 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:23.909119 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9312f02-350c-400a-bfd1-8c37111fc6fc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.478033 Sep 08 13:57:23.925806 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 324/650] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:23 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:23.977973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0dd999b7-6708-4e9c-96a7-3c81be87abef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:23.980433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0dd999b7-6708-4e9c-96a7-3c81be87abef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:23.991750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dd999b7-6708-4e9c-96a7-3c81be87abef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:23.992869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dd999b7-6708-4e9c-96a7-3c81be87abef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:23.993986 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dd999b7-6708-4e9c-96a7-3c81be87abef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:23.994936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dd999b7-6708-4e9c-96a7-3c81be87abef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:23.996060 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dd999b7-6708-4e9c-96a7-3c81be87abef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:23.996885 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0dd999b7-6708-4e9c-96a7-3c81be87abef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:24.155306 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-04eb7f80-0f07-4563-b71a-ebb0df3b9dda tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:24.181878 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-04eb7f80-0f07-4563-b71a-ebb0df3b9dda tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.811635 Sep 08 13:57:24.189867 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 327/651] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:23 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:24.210514 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-77873a76-eab0-4551-9da8-4f43a4b9969f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:24.211149 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-77873a76-eab0-4551-9da8-4f43a4b9969f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:24.220696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77873a76-eab0-4551-9da8-4f43a4b9969f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:24.221402 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77873a76-eab0-4551-9da8-4f43a4b9969f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:24.222103 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77873a76-eab0-4551-9da8-4f43a4b9969f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:24.225552 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77873a76-eab0-4551-9da8-4f43a4b9969f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:24.226317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77873a76-eab0-4551-9da8-4f43a4b9969f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:24.226964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-77873a76-eab0-4551-9da8-4f43a4b9969f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:24.433418 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0dd999b7-6708-4e9c-96a7-3c81be87abef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:24.442332 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0dd999b7-6708-4e9c-96a7-3c81be87abef tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.469059 Sep 08 13:57:24.443510 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 325/652] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:23 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:24.531136 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-77873a76-eab0-4551-9da8-4f43a4b9969f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:24.541490 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-77873a76-eab0-4551-9da8-4f43a4b9969f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.350172 Sep 08 13:57:24.554467 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 328/653] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:24 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:24.946046 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:24.947200 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:24.961827 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:24.962561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:24.963133 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:24.964310 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:24.964858 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:24.965359 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:25.201788 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:25.209183 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2dbe0c3b-2a0f-4fa6-bccb-70beffaec2a3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:25.210268 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2dbe0c3b-2a0f-4fa6-bccb-70beffaec2a3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:25.218657 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:25.220365 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:25.222418 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-57be9717-dd5d-4ccb-b1e1-1eecc88b453d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.281723 Sep 08 13:57:25.223714 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 326/654] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:24 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:25.225680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dbe0c3b-2a0f-4fa6-bccb-70beffaec2a3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:25.230534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dbe0c3b-2a0f-4fa6-bccb-70beffaec2a3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:25.231234 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dbe0c3b-2a0f-4fa6-bccb-70beffaec2a3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:25.232121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dbe0c3b-2a0f-4fa6-bccb-70beffaec2a3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:25.232807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dbe0c3b-2a0f-4fa6-bccb-70beffaec2a3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:25.233389 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2dbe0c3b-2a0f-4fa6-bccb-70beffaec2a3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:25.417255 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2dbe0c3b-2a0f-4fa6-bccb-70beffaec2a3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:25.434841 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2dbe0c3b-2a0f-4fa6-bccb-70beffaec2a3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.229740 Sep 08 13:57:25.435953 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 329/655] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:25 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:25.468376 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-61363e0e-a0a7-423b-a03f-4885d05f12da tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:25.468998 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-61363e0e-a0a7-423b-a03f-4885d05f12da tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:25.476204 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61363e0e-a0a7-423b-a03f-4885d05f12da tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:25.476701 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61363e0e-a0a7-423b-a03f-4885d05f12da tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:25.477146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61363e0e-a0a7-423b-a03f-4885d05f12da tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:25.477877 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61363e0e-a0a7-423b-a03f-4885d05f12da tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:25.478513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61363e0e-a0a7-423b-a03f-4885d05f12da tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:25.479116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-61363e0e-a0a7-423b-a03f-4885d05f12da tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:25.568142 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-afba7f6b-11b5-4047-8f22-8a01d2e38654 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:25.569596 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-afba7f6b-11b5-4047-8f22-8a01d2e38654 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:25.577953 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afba7f6b-11b5-4047-8f22-8a01d2e38654 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:25.578607 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afba7f6b-11b5-4047-8f22-8a01d2e38654 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:25.579047 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afba7f6b-11b5-4047-8f22-8a01d2e38654 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:25.579751 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afba7f6b-11b5-4047-8f22-8a01d2e38654 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:25.580204 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afba7f6b-11b5-4047-8f22-8a01d2e38654 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:25.580627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-afba7f6b-11b5-4047-8f22-8a01d2e38654 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:25.755740 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-61363e0e-a0a7-423b-a03f-4885d05f12da tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:25.768483 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-61363e0e-a0a7-423b-a03f-4885d05f12da tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.303932 Sep 08 13:57:25.771044 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 327/656] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:25 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:25.894492 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-afba7f6b-11b5-4047-8f22-8a01d2e38654 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:25.910967 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-afba7f6b-11b5-4047-8f22-8a01d2e38654 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.346875 Sep 08 13:57:25.911735 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 330/657] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:25 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:26.250282 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:26.250933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:26.274087 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:26.274839 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:26.275463 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:26.276347 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:26.276951 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:26.277526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:26.459738 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b8f0c48-714c-4b1b-8632-8af7fdc7e04d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:26.462594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b8f0c48-714c-4b1b-8632-8af7fdc7e04d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:26.480653 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c48-714c-4b1b-8632-8af7fdc7e04d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:26.482145 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c48-714c-4b1b-8632-8af7fdc7e04d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:26.482759 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c48-714c-4b1b-8632-8af7fdc7e04d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:26.483656 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c48-714c-4b1b-8632-8af7fdc7e04d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:26.484235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c48-714c-4b1b-8632-8af7fdc7e04d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:26.484534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c48-714c-4b1b-8632-8af7fdc7e04d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:26.700747 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:26.710525 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:26.722811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:26.724279 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-62d227b9-46e7-4052-942e-7252332dd1b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.479680 Sep 08 13:57:26.725040 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 328/658] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:26 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:26.795921 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fb107088-1578-4c3b-973f-729a5b3c5382 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:26.797006 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fb107088-1578-4c3b-973f-729a5b3c5382 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:26.807884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb107088-1578-4c3b-973f-729a5b3c5382 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:26.808937 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb107088-1578-4c3b-973f-729a5b3c5382 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:26.814440 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb107088-1578-4c3b-973f-729a5b3c5382 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:26.815908 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb107088-1578-4c3b-973f-729a5b3c5382 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:26.816506 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb107088-1578-4c3b-973f-729a5b3c5382 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:26.816955 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fb107088-1578-4c3b-973f-729a5b3c5382 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:26.868733 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5b8f0c48-714c-4b1b-8632-8af7fdc7e04d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:26.891078 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b8f0c48-714c-4b1b-8632-8af7fdc7e04d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.426914 Sep 08 13:57:26.892040 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 331/659] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:26 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:26.940819 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-985e8298-643b-47eb-a046-b8791b4b81b4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:26.942003 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-985e8298-643b-47eb-a046-b8791b4b81b4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:26.948786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985e8298-643b-47eb-a046-b8791b4b81b4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:26.949538 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985e8298-643b-47eb-a046-b8791b4b81b4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:26.950241 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985e8298-643b-47eb-a046-b8791b4b81b4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:26.951702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985e8298-643b-47eb-a046-b8791b4b81b4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:26.952333 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985e8298-643b-47eb-a046-b8791b4b81b4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:26.952955 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-985e8298-643b-47eb-a046-b8791b4b81b4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:27.187869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-fb107088-1578-4c3b-973f-729a5b3c5382 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:27.196678 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fb107088-1578-4c3b-973f-729a5b3c5382 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.407890 Sep 08 13:57:27.209988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 329/660] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:26 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:27.265292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-985e8298-643b-47eb-a046-b8791b4b81b4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:27.274207 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-985e8298-643b-47eb-a046-b8791b4b81b4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.337060 Sep 08 13:57:27.275106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 332/661] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:26 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:27.770652 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:27.771269 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:27.791229 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:27.793084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:27.794354 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:27.799214 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:27.800028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:27.806159 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:27.918456 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c9641f86-4b17-4655-8687-aaab2006ffb9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:27.921918 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c9641f86-4b17-4655-8687-aaab2006ffb9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:27.951610 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9641f86-4b17-4655-8687-aaab2006ffb9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:27.954224 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9641f86-4b17-4655-8687-aaab2006ffb9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:27.957015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9641f86-4b17-4655-8687-aaab2006ffb9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:27.958606 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9641f86-4b17-4655-8687-aaab2006ffb9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:27.960599 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9641f86-4b17-4655-8687-aaab2006ffb9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:27.966282 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c9641f86-4b17-4655-8687-aaab2006ffb9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:28.424040 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:28.447304 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:28.448759 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:28.462539 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa0be9f1-48fd-4dbc-b0f3-d197ea02302d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.686904 Sep 08 13:57:28.463393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 330/662] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:27 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:28.490467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c27b0b22-9381-4275-b3ab-bc8156ef4a26 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:28.502591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c9641f86-4b17-4655-8687-aaab2006ffb9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:28.507741 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c27b0b22-9381-4275-b3ab-bc8156ef4a26 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:28.521434 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c9641f86-4b17-4655-8687-aaab2006ffb9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.606651 Sep 08 13:57:28.536664 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c27b0b22-9381-4275-b3ab-bc8156ef4a26 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:28.536664 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c27b0b22-9381-4275-b3ab-bc8156ef4a26 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:28.536664 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c27b0b22-9381-4275-b3ab-bc8156ef4a26 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:28.536664 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c27b0b22-9381-4275-b3ab-bc8156ef4a26 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:28.537634 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c27b0b22-9381-4275-b3ab-bc8156ef4a26 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:28.537634 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c27b0b22-9381-4275-b3ab-bc8156ef4a26 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:28.540126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 333/663] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:27 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:28.546906 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d9cac3d9-32f4-4c95-9f0a-a60636c8743c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:28.550695 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d9cac3d9-32f4-4c95-9f0a-a60636c8743c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:28.571616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9cac3d9-32f4-4c95-9f0a-a60636c8743c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:28.581005 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9cac3d9-32f4-4c95-9f0a-a60636c8743c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:28.581803 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9cac3d9-32f4-4c95-9f0a-a60636c8743c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:28.582793 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9cac3d9-32f4-4c95-9f0a-a60636c8743c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:28.583480 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9cac3d9-32f4-4c95-9f0a-a60636c8743c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:28.587451 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d9cac3d9-32f4-4c95-9f0a-a60636c8743c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:28.606792 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:28.994274 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c27b0b22-9381-4275-b3ab-bc8156ef4a26 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:29.015520 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d9cac3d9-32f4-4c95-9f0a-a60636c8743c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:29.017387 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c27b0b22-9381-4275-b3ab-bc8156ef4a26 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.530687 Sep 08 13:57:29.021089 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 331/664] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:28 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:29.027125 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d9cac3d9-32f4-4c95-9f0a-a60636c8743c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1676 microversion: 2.1 time: 0.485619 Sep 08 13:57:29.037151 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 334/665] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:28 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1676 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:29.492811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:29.493772 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:29.500686 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:29.501366 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:29.502026 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:29.502934 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:29.504008 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:29.507193 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:29.544862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e43d5857-4bd2-4ced-b236-2bf1eb9590ac tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:29.545545 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e43d5857-4bd2-4ced-b236-2bf1eb9590ac tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:29.562232 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e43d5857-4bd2-4ced-b236-2bf1eb9590ac tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:29.562779 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e43d5857-4bd2-4ced-b236-2bf1eb9590ac tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:29.563217 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e43d5857-4bd2-4ced-b236-2bf1eb9590ac tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:29.563928 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e43d5857-4bd2-4ced-b236-2bf1eb9590ac tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:29.564384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e43d5857-4bd2-4ced-b236-2bf1eb9590ac tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:29.565476 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e43d5857-4bd2-4ced-b236-2bf1eb9590ac tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:29.782822 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:29.811110 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:29.817787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:29.824815 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-027af11a-5783-4661-9e46-d676d890b785 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.336161 Sep 08 13:57:29.826203 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 332/666] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:29 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:29.967054 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e43d5857-4bd2-4ced-b236-2bf1eb9590ac tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:29.977042 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e43d5857-4bd2-4ced-b236-2bf1eb9590ac tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.436960 Sep 08 13:57:29.982550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 335/667] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:29 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:30.055604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7442149a-cc2d-4c53-b567-1f2481e0ed42 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:30.061603 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7442149a-cc2d-4c53-b567-1f2481e0ed42 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:30.064776 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd833a0b-314f-4f7c-bed7-ba5b63c2b2d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:30.065395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd833a0b-314f-4f7c-bed7-ba5b63c2b2d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:30.082252 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd833a0b-314f-4f7c-bed7-ba5b63c2b2d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:30.082768 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd833a0b-314f-4f7c-bed7-ba5b63c2b2d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:30.083210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd833a0b-314f-4f7c-bed7-ba5b63c2b2d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:30.084006 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd833a0b-314f-4f7c-bed7-ba5b63c2b2d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:30.084123 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7442149a-cc2d-4c53-b567-1f2481e0ed42 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:30.084601 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7442149a-cc2d-4c53-b567-1f2481e0ed42 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:30.085048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7442149a-cc2d-4c53-b567-1f2481e0ed42 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:30.085804 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7442149a-cc2d-4c53-b567-1f2481e0ed42 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:30.086273 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7442149a-cc2d-4c53-b567-1f2481e0ed42 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:30.086695 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7442149a-cc2d-4c53-b567-1f2481e0ed42 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:30.086881 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd833a0b-314f-4f7c-bed7-ba5b63c2b2d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:30.087670 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd833a0b-314f-4f7c-bed7-ba5b63c2b2d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:30.621501 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd833a0b-314f-4f7c-bed7-ba5b63c2b2d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:30.633206 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd833a0b-314f-4f7c-bed7-ba5b63c2b2d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.586115 Sep 08 13:57:30.633816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 333/668] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:30 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:30.638473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7442149a-cc2d-4c53-b567-1f2481e0ed42 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:30.647765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7442149a-cc2d-4c53-b567-1f2481e0ed42 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1653 microversion: 2.1 time: 0.597339 Sep 08 13:57:30.657427 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 336/669] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:30 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1653 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:30.673750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cdb85460-d4ea-4049-b2a7-56466adf742b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:30.680596 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdb85460-d4ea-4049-b2a7-56466adf742b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:30.681334 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdb85460-d4ea-4049-b2a7-56466adf742b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:30.681985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cdb85460-d4ea-4049-b2a7-56466adf742b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:30.710615 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cdb85460-d4ea-4049-b2a7-56466adf742b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Going to try to start instance {{(pid=126920) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 13:57:30.768708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cdb85460-d4ea-4049-b2a7-56466adf742b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "POST /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/action" status: 202 len: 0 microversion: 2.1 time: 0.099401 Sep 08 13:57:30.772409 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 334/670] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:57:30 2022] POST /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:57:30.778631 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c28afd9d-dd88-4f85-82da-89a652a5c2d8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:30.779409 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c28afd9d-dd88-4f85-82da-89a652a5c2d8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:30.786239 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28afd9d-dd88-4f85-82da-89a652a5c2d8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:30.786816 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28afd9d-dd88-4f85-82da-89a652a5c2d8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:30.787314 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28afd9d-dd88-4f85-82da-89a652a5c2d8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:30.788249 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28afd9d-dd88-4f85-82da-89a652a5c2d8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:30.788771 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28afd9d-dd88-4f85-82da-89a652a5c2d8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:30.789556 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28afd9d-dd88-4f85-82da-89a652a5c2d8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:30.852786 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:30.856739 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:30.862422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:30.862986 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:30.863487 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:30.864254 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:30.865765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:30.866307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:31.035565 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c28afd9d-dd88-4f85-82da-89a652a5c2d8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:31.049335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c28afd9d-dd88-4f85-82da-89a652a5c2d8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1662 microversion: 2.1 time: 0.275182 Sep 08 13:57:31.051791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 337/671] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:30 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1662 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:31.058016 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d2b4a6cc-6636-49fa-95ee-a0d6c7a61772 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:31.060213 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d2b4a6cc-6636-49fa-95ee-a0d6c7a61772 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:31.068763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b4a6cc-6636-49fa-95ee-a0d6c7a61772 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:31.069837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:31.070887 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b4a6cc-6636-49fa-95ee-a0d6c7a61772 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:31.072322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b4a6cc-6636-49fa-95ee-a0d6c7a61772 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:31.074630 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b4a6cc-6636-49fa-95ee-a0d6c7a61772 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:31.075583 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b4a6cc-6636-49fa-95ee-a0d6c7a61772 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:31.076201 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d2b4a6cc-6636-49fa-95ee-a0d6c7a61772 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:31.080787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:31.082182 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:31.083535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b6096799-46e1-4aef-a757-f3ca7625a3ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.235358 Sep 08 13:57:31.094442 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 335/672] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:30 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:31.237237 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d2b4a6cc-6636-49fa-95ee-a0d6c7a61772 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:31.247522 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d2b4a6cc-6636-49fa-95ee-a0d6c7a61772 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1365 microversion: 2.1 time: 0.193678 Sep 08 13:57:31.248404 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 338/673] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:31 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:31.660860 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9c64572e-a9c6-4474-9530-ffd27c85196e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:31.662182 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9c64572e-a9c6-4474-9530-ffd27c85196e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:31.672265 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c64572e-a9c6-4474-9530-ffd27c85196e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:31.673985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c64572e-a9c6-4474-9530-ffd27c85196e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:31.674747 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c64572e-a9c6-4474-9530-ffd27c85196e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:31.676170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c64572e-a9c6-4474-9530-ffd27c85196e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:31.676709 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c64572e-a9c6-4474-9530-ffd27c85196e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:31.677186 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c64572e-a9c6-4474-9530-ffd27c85196e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:31.884819 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9c64572e-a9c6-4474-9530-ffd27c85196e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:31.894164 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9c64572e-a9c6-4474-9530-ffd27c85196e tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.239932 Sep 08 13:57:31.894750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 336/674] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:31 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:32.077517 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2acd9ff0-3a01-40ed-a27e-2af7242aafd9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:32.078971 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2acd9ff0-3a01-40ed-a27e-2af7242aafd9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:32.088368 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:32.090415 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2acd9ff0-3a01-40ed-a27e-2af7242aafd9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.091224 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2acd9ff0-3a01-40ed-a27e-2af7242aafd9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.092463 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2acd9ff0-3a01-40ed-a27e-2af7242aafd9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:32.093908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2acd9ff0-3a01-40ed-a27e-2af7242aafd9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.094598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2acd9ff0-3a01-40ed-a27e-2af7242aafd9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.095379 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2acd9ff0-3a01-40ed-a27e-2af7242aafd9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:32.112205 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:32.113468 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:32.131113 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.132630 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.135579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:32.136888 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.138468 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.139083 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:32.364590 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2acd9ff0-3a01-40ed-a27e-2af7242aafd9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:32.373855 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2acd9ff0-3a01-40ed-a27e-2af7242aafd9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1662 microversion: 2.1 time: 0.301636 Sep 08 13:57:32.396637 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 339/675] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:32 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1662 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:32.404719 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f2241e8-da04-49fc-9580-f7c9e1f01b66 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:32.405364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1f2241e8-da04-49fc-9580-f7c9e1f01b66 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:32.415710 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f2241e8-da04-49fc-9580-f7c9e1f01b66 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.416205 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f2241e8-da04-49fc-9580-f7c9e1f01b66 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.416635 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f2241e8-da04-49fc-9580-f7c9e1f01b66 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:32.417347 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f2241e8-da04-49fc-9580-f7c9e1f01b66 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.417819 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f2241e8-da04-49fc-9580-f7c9e1f01b66 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.418241 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f2241e8-da04-49fc-9580-f7c9e1f01b66 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:32.464915 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:32.478953 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:32.480782 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:32.482602 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ed8c416c-1496-433d-875d-430e7c4b0923 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.375577 Sep 08 13:57:32.483717 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 337/676] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:32 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:32.614781 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-1f2241e8-da04-49fc-9580-f7c9e1f01b66 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:32.624627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f2241e8-da04-49fc-9580-f7c9e1f01b66 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1555 microversion: 2.1 time: 0.226390 Sep 08 13:57:32.625968 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 340/677] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:32 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1555 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:32.648939 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3eee43d2-86ee-4e12-80df-13893cfceadf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:32.649671 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3eee43d2-86ee-4e12-80df-13893cfceadf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:32.656755 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eee43d2-86ee-4e12-80df-13893cfceadf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.657427 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eee43d2-86ee-4e12-80df-13893cfceadf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.658226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eee43d2-86ee-4e12-80df-13893cfceadf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:32.659120 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eee43d2-86ee-4e12-80df-13893cfceadf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.659745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eee43d2-86ee-4e12-80df-13893cfceadf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.660234 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3eee43d2-86ee-4e12-80df-13893cfceadf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:32.750146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3eee43d2-86ee-4e12-80df-13893cfceadf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105559 Sep 08 13:57:32.750742 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 338/678] 10.222.0.55 () {58 vars in 1275 bytes} [Thu Sep 8 13:57:32 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:57:32.838175 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0622c747-3747-4c5b-892d-2207c2fdd1c3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Action: 'create', calling method: .version_select at 0x7f5be42c1e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-327996144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmGPUkx2uG8yzKv1WdsvCmYKl8eFGe+8+WkFXrDmCemEfntQ8PDzyYgsD6lbBAapRghSELUFpsxe16kf+G3kGQp4GOKQQec40pcvcggdjNYRX5+CtHppRGi2Ix7tvX8zQ=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:32.855092 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-0622c747-3747-4c5b-892d-2207c2fdd1c3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Getting quotas for project 19d114fd258a4306b4c0665df90ae4c7. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:57:32.860161 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-0622c747-3747-4c5b-892d-2207c2fdd1c3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Getting quotas for user 76a9dc3ddb144e599a2856fce8dc339d and project 19d114fd258a4306b4c0665df90ae4c7. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:57:32.887524 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0622c747-3747-4c5b-892d-2207c2fdd1c3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.238512 Sep 08 13:57:32.888447 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 341/679] 10.222.0.55 () {60 vars in 1159 bytes} [Thu Sep 8 13:57:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:57:32.918013 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-baca0618-b655-4e9f-b3c7-8775ad0a5301 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:32.920082 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-baca0618-b655-4e9f-b3c7-8775ad0a5301 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:32.927637 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-baca0618-b655-4e9f-b3c7-8775ad0a5301 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.928489 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-baca0618-b655-4e9f-b3c7-8775ad0a5301 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.929100 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-baca0618-b655-4e9f-b3c7-8775ad0a5301 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:32.930328 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-baca0618-b655-4e9f-b3c7-8775ad0a5301 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.930894 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-baca0618-b655-4e9f-b3c7-8775ad0a5301 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.931403 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-baca0618-b655-4e9f-b3c7-8775ad0a5301 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:33.406844 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3eff6dc2-8dda-416a-b1fc-9a56c8dca2ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:33.408467 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3eff6dc2-8dda-416a-b1fc-9a56c8dca2ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:33.417768 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eff6dc2-8dda-416a-b1fc-9a56c8dca2ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:33.419264 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eff6dc2-8dda-416a-b1fc-9a56c8dca2ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:33.420002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eff6dc2-8dda-416a-b1fc-9a56c8dca2ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:33.421793 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eff6dc2-8dda-416a-b1fc-9a56c8dca2ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:33.422741 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eff6dc2-8dda-416a-b1fc-9a56c8dca2ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:33.423323 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3eff6dc2-8dda-416a-b1fc-9a56c8dca2ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:33.430247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:33.472084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-baca0618-b655-4e9f-b3c7-8775ad0a5301 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:33.484808 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-baca0618-b655-4e9f-b3c7-8775ad0a5301 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.571177 Sep 08 13:57:33.491513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 339/680] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:32 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:33.514421 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:33.515218 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:33.522252 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:33.523009 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:33.523847 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:33.524721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:33.525318 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:33.526563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:33.919146 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3eff6dc2-8dda-416a-b1fc-9a56c8dca2ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:33.930221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3eff6dc2-8dda-416a-b1fc-9a56c8dca2ec tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1662 microversion: 2.1 time: 0.529614 Sep 08 13:57:33.941786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 342/681] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:33 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1662 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:34.023265 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:34.034241 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:34.035905 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:34.037369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b5734e5c-76ee-4e5b-94e0-2a7f042345ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.529388 Sep 08 13:57:34.038435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 340/682] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:33 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:34.519637 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1e225bb6-1360-47e1-8526-b93051e2c73d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:34.520250 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1e225bb6-1360-47e1-8526-b93051e2c73d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:34.527075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e225bb6-1360-47e1-8526-b93051e2c73d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:34.527579 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e225bb6-1360-47e1-8526-b93051e2c73d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:34.528688 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e225bb6-1360-47e1-8526-b93051e2c73d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:34.529567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e225bb6-1360-47e1-8526-b93051e2c73d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:34.530180 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e225bb6-1360-47e1-8526-b93051e2c73d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:34.530788 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1e225bb6-1360-47e1-8526-b93051e2c73d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:34.956235 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a4c0ab89-7923-445a-84fb-aff2f2131adc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:34.957343 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a4c0ab89-7923-445a-84fb-aff2f2131adc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:34.964611 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4c0ab89-7923-445a-84fb-aff2f2131adc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:34.965101 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4c0ab89-7923-445a-84fb-aff2f2131adc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:34.965761 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4c0ab89-7923-445a-84fb-aff2f2131adc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:34.966514 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4c0ab89-7923-445a-84fb-aff2f2131adc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:34.967044 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4c0ab89-7923-445a-84fb-aff2f2131adc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:34.967372 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4c0ab89-7923-445a-84fb-aff2f2131adc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:35.080006 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-1e225bb6-1360-47e1-8526-b93051e2c73d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:35.091718 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1e225bb6-1360-47e1-8526-b93051e2c73d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.575800 Sep 08 13:57:35.092760 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 343/683] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:34 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:35.098109 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:35.098970 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:35.106185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:35.108575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:35.109175 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:35.110085 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:35.110675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:35.111373 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:35.238444 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a4c0ab89-7923-445a-84fb-aff2f2131adc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:35.248593 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a4c0ab89-7923-445a-84fb-aff2f2131adc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1662 microversion: 2.1 time: 0.297266 Sep 08 13:57:35.249864 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 341/684] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:34 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1662 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:35.336059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-bb0428e8-b7b3-4040-aca8-0a0e7383ba1f req-41fc9648-54c9-4c03-8ba7-368bf2515aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b6fbb8-a2c9-4c92-b120-8ea3259c9b56", "tag": "c57d5f48-246f-41c1-903a-f9a3fa47d52b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:35.347509 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bb0428e8-b7b3-4040-aca8-0a0e7383ba1f req-41fc9648-54c9-4c03-8ba7-368bf2515aa3 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:35.348342 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bb0428e8-b7b3-4040-aca8-0a0e7383ba1f req-41fc9648-54c9-4c03-8ba7-368bf2515aa3 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:35.348956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-bb0428e8-b7b3-4040-aca8-0a0e7383ba1f req-41fc9648-54c9-4c03-8ba7-368bf2515aa3 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:35.362033 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-bb0428e8-b7b3-4040-aca8-0a0e7383ba1f req-41fc9648-54c9-4c03-8ba7-368bf2515aa3 service nova] Creating event network-changed:c57d5f48-246f-41c1-903a-f9a3fa47d52b for instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 on hv-cinder-82002 Sep 08 13:57:35.369004 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-bb0428e8-b7b3-4040-aca8-0a0e7383ba1f req-41fc9648-54c9-4c03-8ba7-368bf2515aa3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037696 Sep 08 13:57:35.370452 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 342/685] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:57:35.455497 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:35.465817 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:35.467285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:35.468704 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f258b71c-ebf2-4756-893d-23c3c6570046 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.374497 Sep 08 13:57:35.469263 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 344/686] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:35 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:36.120450 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b6a130fe-4366-4f86-8ea8-faba6fc2e205 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:36.121201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b6a130fe-4366-4f86-8ea8-faba6fc2e205 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:36.129056 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6a130fe-4366-4f86-8ea8-faba6fc2e205 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:36.129602 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6a130fe-4366-4f86-8ea8-faba6fc2e205 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:36.130421 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6a130fe-4366-4f86-8ea8-faba6fc2e205 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:36.131250 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6a130fe-4366-4f86-8ea8-faba6fc2e205 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:36.131805 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6a130fe-4366-4f86-8ea8-faba6fc2e205 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:36.132467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b6a130fe-4366-4f86-8ea8-faba6fc2e205 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:36.276067 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-feb199ed-6315-456d-815e-d23d93e66a9c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:36.276670 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-feb199ed-6315-456d-815e-d23d93e66a9c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:36.288369 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-feb199ed-6315-456d-815e-d23d93e66a9c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:36.289130 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-feb199ed-6315-456d-815e-d23d93e66a9c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:36.289708 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-feb199ed-6315-456d-815e-d23d93e66a9c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:36.290659 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-feb199ed-6315-456d-815e-d23d93e66a9c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:36.291491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-feb199ed-6315-456d-815e-d23d93e66a9c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:36.291916 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-feb199ed-6315-456d-815e-d23d93e66a9c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:36.392359 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b6a130fe-4366-4f86-8ea8-faba6fc2e205 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:36.412170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b6a130fe-4366-4f86-8ea8-faba6fc2e205 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.296211 Sep 08 13:57:36.413107 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 343/687] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:36 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:36.501291 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:36.502479 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:36.509059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:36.510034 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:36.511028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:36.512002 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:36.512855 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-feb199ed-6315-456d-815e-d23d93e66a9c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:36.513167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:36.513834 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:36.525494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-feb199ed-6315-456d-815e-d23d93e66a9c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1666 microversion: 2.1 time: 0.253156 Sep 08 13:57:36.526109 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 345/688] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:36 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1666 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:36.763655 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:36.772545 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:36.774008 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:36.775177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d10120d0-4f30-4914-9cee-4d1d6a074432 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.283052 Sep 08 13:57:36.776034 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 344/689] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:36 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:37.436298 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-913cfce1-17df-4980-9f54-0eaeaa39d390 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:37.436849 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-913cfce1-17df-4980-9f54-0eaeaa39d390 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:37.443222 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-913cfce1-17df-4980-9f54-0eaeaa39d390 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:37.443710 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-913cfce1-17df-4980-9f54-0eaeaa39d390 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:37.444145 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-913cfce1-17df-4980-9f54-0eaeaa39d390 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:37.444845 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-913cfce1-17df-4980-9f54-0eaeaa39d390 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:37.445302 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-913cfce1-17df-4980-9f54-0eaeaa39d390 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:37.445722 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-913cfce1-17df-4980-9f54-0eaeaa39d390 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:37.584988 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-913cfce1-17df-4980-9f54-0eaeaa39d390 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:37.594947 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-913cfce1-17df-4980-9f54-0eaeaa39d390 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.163376 Sep 08 13:57:37.595948 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 346/690] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:37 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:37.804423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:37.805155 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:37.813387 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:37.813990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:37.814427 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:37.815129 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:37.815585 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:37.816010 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:37.955133 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:37.968107 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:37.970800 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:37.972190 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ba58353-978f-458d-b829-f5560ea50848 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.175551 Sep 08 13:57:37.972786 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 345/691] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:37 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:38.617723 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f33c4205-1551-4197-b180-3632f922c06a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:38.618351 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f33c4205-1551-4197-b180-3632f922c06a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:38.626619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33c4205-1551-4197-b180-3632f922c06a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:38.630305 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33c4205-1551-4197-b180-3632f922c06a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:38.630879 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33c4205-1551-4197-b180-3632f922c06a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:38.631806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33c4205-1551-4197-b180-3632f922c06a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:38.632384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33c4205-1551-4197-b180-3632f922c06a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:38.632839 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f33c4205-1551-4197-b180-3632f922c06a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:38.776802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f33c4205-1551-4197-b180-3632f922c06a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:38.785631 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f33c4205-1551-4197-b180-3632f922c06a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.171734 Sep 08 13:57:38.786481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 347/692] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:38 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:38.997180 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:38.997720 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:39.004287 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:39.004766 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:39.005198 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:39.006000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:39.006463 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:39.006907 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:39.142884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:39.151324 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:39.153710 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:39.154883 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c3970224-78df-44f5-b49e-79cd4a9608f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.161731 Sep 08 13:57:39.155439 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 346/693] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:38 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:39.810545 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3b347f90-82ae-47e4-a858-aa21fa92e0fd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:39.811804 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3b347f90-82ae-47e4-a858-aa21fa92e0fd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:39.818673 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b347f90-82ae-47e4-a858-aa21fa92e0fd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:39.819318 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b347f90-82ae-47e4-a858-aa21fa92e0fd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:39.821635 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b347f90-82ae-47e4-a858-aa21fa92e0fd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:39.822404 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b347f90-82ae-47e4-a858-aa21fa92e0fd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:39.822862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b347f90-82ae-47e4-a858-aa21fa92e0fd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:39.823283 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3b347f90-82ae-47e4-a858-aa21fa92e0fd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:39.959319 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3b347f90-82ae-47e4-a858-aa21fa92e0fd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:39.967773 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3b347f90-82ae-47e4-a858-aa21fa92e0fd tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.161438 Sep 08 13:57:39.968328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 348/694] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:39 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:40.180474 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:40.181028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:40.187556 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:40.188056 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:40.188494 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:40.189252 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:40.189845 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:40.190358 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:40.327843 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:40.331299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:40.337053 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:40.338533 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:40.339999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3cd7f88d-e5ad-4021-8d38-1c9e82cbf5bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.163483 Sep 08 13:57:40.341069 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 347/695] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:40 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:40.990155 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0866d120-701b-412b-b543-2e6de7eccf65 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:40.990756 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0866d120-701b-412b-b543-2e6de7eccf65 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:40.997500 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0866d120-701b-412b-b543-2e6de7eccf65 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:40.998124 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0866d120-701b-412b-b543-2e6de7eccf65 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:40.998428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0866d120-701b-412b-b543-2e6de7eccf65 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:40.999110 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0866d120-701b-412b-b543-2e6de7eccf65 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:40.999549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0866d120-701b-412b-b543-2e6de7eccf65 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:40.999963 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0866d120-701b-412b-b543-2e6de7eccf65 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:41.132045 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0866d120-701b-412b-b543-2e6de7eccf65 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:41.140677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0866d120-701b-412b-b543-2e6de7eccf65 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1735 microversion: 2.1 time: 0.154258 Sep 08 13:57:41.141223 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 349/696] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:40 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:41.366684 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:41.367371 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:41.375623 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:41.376104 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:41.376525 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:41.377223 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:41.377665 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:41.378139 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:41.513987 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:41.522937 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:41.524382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:41.525535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6de7ed94-cff4-4909-8a14-9d17e80feaf1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.162808 Sep 08 13:57:41.526123 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 348/697] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:41 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:42.163541 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c3641a1b-b246-45a4-86fc-20bb16fc2c7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:42.164114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c3641a1b-b246-45a4-86fc-20bb16fc2c7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:42.170948 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3641a1b-b246-45a4-86fc-20bb16fc2c7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.171426 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3641a1b-b246-45a4-86fc-20bb16fc2c7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.172168 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3641a1b-b246-45a4-86fc-20bb16fc2c7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.172959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3641a1b-b246-45a4-86fc-20bb16fc2c7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.173431 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3641a1b-b246-45a4-86fc-20bb16fc2c7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.174048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3641a1b-b246-45a4-86fc-20bb16fc2c7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.311010 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c3641a1b-b246-45a4-86fc-20bb16fc2c7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:42.319132 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c3641a1b-b246-45a4-86fc-20bb16fc2c7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1715 microversion: 2.1 time: 0.159591 Sep 08 13:57:42.319690 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 350/698] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:42 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:42.435892 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:42.436422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:42.442750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.443229 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.443661 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.444351 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.444804 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.445233 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.526194 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] HTTP exception thrown: Cannot 'detach_volume' instance 21bead64-8c72-4cb8-806b-f68b2fc593cc while it is in vm_state rescued Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Request method failure captured: Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments/161ca7c8-30ae-4481-9e2c-fdb8658f2c47 HTTP/1.1 Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOqXoy_jlQIcZGQ-ASMeE8UfdjfJ-ZihXwARCECew2uUYEJfMfCz4Rpk1P8GXDhQweMznN18TYBN46-yUNN374-KOAFI0-TsMI8X4KAfqsDS34nfplWRAAQSTE1yMbeUr-5QSIeMgvOItm1HaVoYnDByAwRWoy1gn4Ja99jHM4ADiM Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 127bce2080d54fe4871b5aaa6cc394b5 Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:57:42.528660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:57:42.530378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_127bce2080d54fe4871b5aaa6cc394b5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:57:42.530378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:57:42.530378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 127bce2080d54fe4871b5aaa6cc394b5 Sep 08 13:57:42.530378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:57:42.530378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-ServerRescueNegativeTestJSON-486286006-project Sep 08 13:57:42.530378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:57:42.530378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:57:42.530378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 9f07158e4fd1430e839a1592e1e11b58 Sep 08 13:57:42.530378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-486286006-project Sep 08 13:57:42.530378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 13:57:42.530378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Cannot 'detach_volume' instance 21bead64-8c72-4cb8-806b-f68b2fc593cc while it is in vm_state rescued Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'server_id': '21bead64-8c72-4cb8-806b-f68b2fc593cc', 'id': '161ca7c8-30ae-4481-9e2c-fdb8658f2c47'} Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 21bead64-8c72-4cb8-806b-f68b2fc593cc in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:57:42.531635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 21bead64-8c72-4cb8-806b-f68b2fc593cc while it is in vm_state rescued Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 21bead64-8c72-4cb8-806b-f68b2fc593cc while it is in vm_state rescued Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:57:42.533811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Returning 409 to user: Cannot 'detach_volume' instance 21bead64-8c72-4cb8-806b-f68b2fc593cc while it is in vm_state rescued {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:57:42.535044 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1466ad5a-81c8-4505-a1d4-9d8a36a0c74f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "DELETE /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments/161ca7c8-30ae-4481-9e2c-fdb8658f2c47" status: 409 len: 152 microversion: 2.1 time: 0.098216 Sep 08 13:57:42.535044 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 349/699] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 13:57:42 2022] DELETE /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments/161ca7c8-30ae-4481-9e2c-fdb8658f2c47 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:57:42.539781 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e63d46f9-36ad-4b89-ad11-773cd215b11c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:42.540316 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e63d46f9-36ad-4b89-ad11-773cd215b11c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:42.546970 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e63d46f9-36ad-4b89-ad11-773cd215b11c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.547458 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e63d46f9-36ad-4b89-ad11-773cd215b11c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.547891 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e63d46f9-36ad-4b89-ad11-773cd215b11c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.548582 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e63d46f9-36ad-4b89-ad11-773cd215b11c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.549040 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e63d46f9-36ad-4b89-ad11-773cd215b11c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.549457 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e63d46f9-36ad-4b89-ad11-773cd215b11c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.552367 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:42.552975 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:42.561354 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.561859 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.562289 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.562991 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.563411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.563833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.616730 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e63d46f9-36ad-4b89-ad11-773cd215b11c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "POST /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/action" status: 202 len: 0 microversion: 2.1 time: 0.080875 Sep 08 13:57:42.617407 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 351/700] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:57:42 2022] POST /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:57:42.625473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee8a234b-e2fe-4207-ac48-46c7e53db4c5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:42.626195 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee8a234b-e2fe-4207-ac48-46c7e53db4c5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:42.634915 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8a234b-e2fe-4207-ac48-46c7e53db4c5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.635402 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8a234b-e2fe-4207-ac48-46c7e53db4c5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.635832 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8a234b-e2fe-4207-ac48-46c7e53db4c5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.636550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8a234b-e2fe-4207-ac48-46c7e53db4c5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.637010 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8a234b-e2fe-4207-ac48-46c7e53db4c5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.637425 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee8a234b-e2fe-4207-ac48-46c7e53db4c5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.794514 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:42.807658 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:42.810755 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:42.812689 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6de99a42-b188-43e8-a91a-de9ff0c2cec4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.263783 Sep 08 13:57:42.813661 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 350/701] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:42 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:42.821535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ecd5c57b-0490-4dfa-9236-a62efe10fdc7 req-9c659dad-b6c0-47ae-b501-53645da1bd1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdb4c65-ed8d-4792-ac96-8b1053b167b5", "name": "network-vif-plugged", "status": "completed", "tag": "c9da782b-975b-4d78-bc93-092cf58fcf3a"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:42.846832 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ecd5c57b-0490-4dfa-9236-a62efe10fdc7 req-9c659dad-b6c0-47ae-b501-53645da1bd1a service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.847618 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ecd5c57b-0490-4dfa-9236-a62efe10fdc7 req-9c659dad-b6c0-47ae-b501-53645da1bd1a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.848349 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ecd5c57b-0490-4dfa-9236-a62efe10fdc7 req-9c659dad-b6c0-47ae-b501-53645da1bd1a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.850709 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee8a234b-e2fe-4207-ac48-46c7e53db4c5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:42.868322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee8a234b-e2fe-4207-ac48-46c7e53db4c5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1723 microversion: 2.1 time: 0.246330 Sep 08 13:57:42.870447 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 352/702] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:42 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:42.882038 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ecd5c57b-0490-4dfa-9236-a62efe10fdc7 req-9c659dad-b6c0-47ae-b501-53645da1bd1a service nova] Creating event network-vif-plugged:c9da782b-975b-4d78-bc93-092cf58fcf3a for instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 on hv-cinder-82002 Sep 08 13:57:42.892468 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ecd5c57b-0490-4dfa-9236-a62efe10fdc7 req-9c659dad-b6c0-47ae-b501-53645da1bd1a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075196 Sep 08 13:57:42.894105 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 351/703] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:43.378571 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b3d0c57e-e48b-46e4-bd51-b8e552b66147 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1678122210"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:43.379134 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b3d0c57e-e48b-46e4-bd51-b8e552b66147 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:43.381127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:43.387664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3d0c57e-e48b-46e4-bd51-b8e552b66147 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:43.388162 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3d0c57e-e48b-46e4-bd51-b8e552b66147 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:43.388595 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3d0c57e-e48b-46e4-bd51-b8e552b66147 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:43.389331 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3d0c57e-e48b-46e4-bd51-b8e552b66147 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:43.389814 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3d0c57e-e48b-46e4-bd51-b8e552b66147 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:43.390235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b3d0c57e-e48b-46e4-bd51-b8e552b66147 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:43.569799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.network.security_group_api [None req-b3d0c57e-e48b-46e4-bd51-b8e552b66147 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Removing security group 0f1e5d94-1b7b-4090-9ab1-0f2f3a565a55 from port ca4283b0-e159-4a24-b0b2-bc113ff78694 Sep 08 13:57:43.842371 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:43.843324 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:43.853089 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:43.853569 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:43.854018 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:43.854718 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:43.855192 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:43.855603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:44.077264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:44.086269 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:44.087718 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:44.088878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-448c3dfc-3d16-4639-a63b-6eb7cb20a1eb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.251835 Sep 08 13:57:44.089702 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 352/704] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:43 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:44.155115 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b505de24-1435-4362-b37c-ac7423e6d089 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:44.155739 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b505de24-1435-4362-b37c-ac7423e6d089 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:44.161708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b505de24-1435-4362-b37c-ac7423e6d089 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:44.161911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b3d0c57e-e48b-46e4-bd51-b8e552b66147 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "POST /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/action" status: 202 len: 0 microversion: 2.1 time: 0.787001 Sep 08 13:57:44.162220 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b505de24-1435-4362-b37c-ac7423e6d089 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:44.162654 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b505de24-1435-4362-b37c-ac7423e6d089 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:44.163342 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b505de24-1435-4362-b37c-ac7423e6d089 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:44.163796 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b505de24-1435-4362-b37c-ac7423e6d089 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:44.164208 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b505de24-1435-4362-b37c-ac7423e6d089 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:44.166288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 353/705] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 13:57:43 2022] POST /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/action => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:57:44.171049 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-d25472bd-bc30-4d3d-ad87-9eea894449db req-100fd5f9-c7c7-4ae0-b2b4-bfb9e726661c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e64a0c9-b7b0-46ff-8526-88164d493140", "tag": "ca4283b0-e159-4a24-b0b2-bc113ff78694"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:44.182871 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d25472bd-bc30-4d3d-ad87-9eea894449db req-100fd5f9-c7c7-4ae0-b2b4-bfb9e726661c service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:44.190310 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d25472bd-bc30-4d3d-ad87-9eea894449db req-100fd5f9-c7c7-4ae0-b2b4-bfb9e726661c service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:44.191074 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-d25472bd-bc30-4d3d-ad87-9eea894449db req-100fd5f9-c7c7-4ae0-b2b4-bfb9e726661c service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:44.210430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-d25472bd-bc30-4d3d-ad87-9eea894449db req-100fd5f9-c7c7-4ae0-b2b4-bfb9e726661c service nova] Creating event network-changed:ca4283b0-e159-4a24-b0b2-bc113ff78694 for instance 6e64a0c9-b7b0-46ff-8526-88164d493140 on hv-cinder-82002 Sep 08 13:57:44.216204 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-d25472bd-bc30-4d3d-ad87-9eea894449db req-100fd5f9-c7c7-4ae0-b2b4-bfb9e726661c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048770 Sep 08 13:57:44.217380 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 354/706] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:44.335069 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b505de24-1435-4362-b37c-ac7423e6d089 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:44.344188 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b505de24-1435-4362-b37c-ac7423e6d089 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1723 microversion: 2.1 time: 0.252910 Sep 08 13:57:44.360646 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 353/707] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:44 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:45.115543 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:45.116233 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:45.122939 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:45.123422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:45.123856 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:45.124547 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:45.125002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:45.125422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:45.367723 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-730ef1ca-a3bf-429f-a369-25a755886081 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:45.368542 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-730ef1ca-a3bf-429f-a369-25a755886081 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:45.375856 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-730ef1ca-a3bf-429f-a369-25a755886081 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:45.376351 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-730ef1ca-a3bf-429f-a369-25a755886081 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:45.376791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-730ef1ca-a3bf-429f-a369-25a755886081 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:45.377504 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-730ef1ca-a3bf-429f-a369-25a755886081 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:45.377988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-730ef1ca-a3bf-429f-a369-25a755886081 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:45.378416 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-730ef1ca-a3bf-429f-a369-25a755886081 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:45.758843 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:45.768016 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-730ef1ca-a3bf-429f-a369-25a755886081 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:45.776554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:45.777998 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:45.779174 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a1f3e6ad-f1ce-4f8b-9d62-98e812773b01 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.668375 Sep 08 13:57:45.782314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-730ef1ca-a3bf-429f-a369-25a755886081 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1723 microversion: 2.1 time: 0.418528 Sep 08 13:57:45.782879 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 354/708] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:45 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1723 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:45.783269 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 355/709] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:45 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:45.815995 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f415a42a-8a4f-4116-8769-ee744b49a8cb tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:45.816492 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f415a42a-8a4f-4116-8769-ee744b49a8cb tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:45.822350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f415a42a-8a4f-4116-8769-ee744b49a8cb tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:45.822831 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f415a42a-8a4f-4116-8769-ee744b49a8cb tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:45.823264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f415a42a-8a4f-4116-8769-ee744b49a8cb tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:45.823958 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f415a42a-8a4f-4116-8769-ee744b49a8cb tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:45.824412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f415a42a-8a4f-4116-8769-ee744b49a8cb tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:45.824837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f415a42a-8a4f-4116-8769-ee744b49a8cb tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:45.907598 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-f415a42a-8a4f-4116-8769-ee744b49a8cb tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lazy-loading 'services' on Instance uuid 6e64a0c9-b7b0-46ff-8526-88164d493140 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:57:45.984799 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f415a42a-8a4f-4116-8769-ee744b49a8cb tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments/12801054-b941-429c-979e-989ba1d4ae5b" status: 202 len: 0 microversion: 2.1 time: 0.172595 Sep 08 13:57:45.985420 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 355/710] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 13:57:45 2022] DELETE /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments/12801054-b941-429c-979e-989ba1d4ae5b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:57:45.994168 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6a24366d-1457-422e-bb74-989f38081d9d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:45.997440 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6a24366d-1457-422e-bb74-989f38081d9d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:46.004202 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a24366d-1457-422e-bb74-989f38081d9d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:46.004763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a24366d-1457-422e-bb74-989f38081d9d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:46.005264 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a24366d-1457-422e-bb74-989f38081d9d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:46.006206 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a24366d-1457-422e-bb74-989f38081d9d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:46.006656 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a24366d-1457-422e-bb74-989f38081d9d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:46.007071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6a24366d-1457-422e-bb74-989f38081d9d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:46.041479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6a24366d-1457-422e-bb74-989f38081d9d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051597 Sep 08 13:57:46.046579 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 356/711] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:57:45 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:57:46.250900 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-97eb867e-f8df-40d8-a016-983b6cb60699 req-867701f8-652d-45ad-87c3-dda363a155bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e64a0c9-b7b0-46ff-8526-88164d493140", "tag": "ca4283b0-e159-4a24-b0b2-bc113ff78694"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:46.260811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-97eb867e-f8df-40d8-a016-983b6cb60699 req-867701f8-652d-45ad-87c3-dda363a155bb service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:46.261318 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-97eb867e-f8df-40d8-a016-983b6cb60699 req-867701f8-652d-45ad-87c3-dda363a155bb service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:46.261796 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-97eb867e-f8df-40d8-a016-983b6cb60699 req-867701f8-652d-45ad-87c3-dda363a155bb service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:46.273255 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-97eb867e-f8df-40d8-a016-983b6cb60699 req-867701f8-652d-45ad-87c3-dda363a155bb service nova] Creating event network-changed:ca4283b0-e159-4a24-b0b2-bc113ff78694 for instance 6e64a0c9-b7b0-46ff-8526-88164d493140 on hv-cinder-82002 Sep 08 13:57:46.278017 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-97eb867e-f8df-40d8-a016-983b6cb60699 req-867701f8-652d-45ad-87c3-dda363a155bb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031786 Sep 08 13:57:46.278612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 356/712] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:46.807556 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f2a0a8cf-adc1-496f-92fc-23b4561c2db1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:46.808221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f2a0a8cf-adc1-496f-92fc-23b4561c2db1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:46.808687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:46.809915 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:46.816008 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2a0a8cf-adc1-496f-92fc-23b4561c2db1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:46.816152 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:46.816500 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2a0a8cf-adc1-496f-92fc-23b4561c2db1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:46.816686 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:46.816933 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2a0a8cf-adc1-496f-92fc-23b4561c2db1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:46.817350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:46.817635 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2a0a8cf-adc1-496f-92fc-23b4561c2db1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:46.818085 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:46.818192 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2a0a8cf-adc1-496f-92fc-23b4561c2db1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:46.818539 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:46.818640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f2a0a8cf-adc1-496f-92fc-23b4561c2db1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:46.818961 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:47.031431 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:47.034590 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f2a0a8cf-adc1-496f-92fc-23b4561c2db1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:47.040115 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:47.041533 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:47.042697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5e449dea-096f-450e-9e84-69bc64ddd933 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.238919 Sep 08 13:57:47.042813 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f2a0a8cf-adc1-496f-92fc-23b4561c2db1 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1723 microversion: 2.1 time: 0.239146 Sep 08 13:57:47.043817 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 357/713] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:46 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:47.043943 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 357/714] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:46 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:47.054458 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97adff9d-03ec-4b25-b666-af8031a243f5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:47.056727 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-97adff9d-03ec-4b25-b666-af8031a243f5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:47.062729 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97adff9d-03ec-4b25-b666-af8031a243f5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:47.063153 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97adff9d-03ec-4b25-b666-af8031a243f5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:47.063699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97adff9d-03ec-4b25-b666-af8031a243f5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:47.064379 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97adff9d-03ec-4b25-b666-af8031a243f5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:47.064948 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97adff9d-03ec-4b25-b666-af8031a243f5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:47.065368 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97adff9d-03ec-4b25-b666-af8031a243f5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:47.092630 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:47.098044 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-97adff9d-03ec-4b25-b666-af8031a243f5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047736 Sep 08 13:57:47.098602 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 358/715] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:57:47 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:48.067013 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-12f56df9-7235-4524-8f60-50d715beeceb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:48.067712 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-12f56df9-7235-4524-8f60-50d715beeceb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:48.070249 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:48.071145 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:48.074733 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f56df9-7235-4524-8f60-50d715beeceb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:48.075219 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f56df9-7235-4524-8f60-50d715beeceb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:48.075647 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f56df9-7235-4524-8f60-50d715beeceb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:48.076374 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f56df9-7235-4524-8f60-50d715beeceb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:48.076822 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f56df9-7235-4524-8f60-50d715beeceb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:48.077242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-12f56df9-7235-4524-8f60-50d715beeceb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:48.078608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:48.079171 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:48.079681 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:48.080455 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:48.081135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:48.081621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:48.290133 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:48.293701 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-12f56df9-7235-4524-8f60-50d715beeceb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:48.299353 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:48.300776 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:48.301943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-12f56df9-7235-4524-8f60-50d715beeceb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1723 microversion: 2.1 time: 0.238888 Sep 08 13:57:48.302096 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-cf1dc85c-d1bf-4143-9106-25fd04b134d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1807 microversion: 2.20 time: 0.237548 Sep 08 13:57:48.302511 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 358/716] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:48 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:48.302640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 359/717] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:48 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:57:48.314126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ca74b13-6fdf-4b32-b9fc-e2c2b2cebb7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:48.316334 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ca74b13-6fdf-4b32-b9fc-e2c2b2cebb7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:48.322357 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ca74b13-6fdf-4b32-b9fc-e2c2b2cebb7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:48.322839 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ca74b13-6fdf-4b32-b9fc-e2c2b2cebb7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:48.323306 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ca74b13-6fdf-4b32-b9fc-e2c2b2cebb7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:48.323995 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ca74b13-6fdf-4b32-b9fc-e2c2b2cebb7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:48.324444 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ca74b13-6fdf-4b32-b9fc-e2c2b2cebb7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:48.324859 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ca74b13-6fdf-4b32-b9fc-e2c2b2cebb7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:48.356927 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ca74b13-6fdf-4b32-b9fc-e2c2b2cebb7a tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046543 Sep 08 13:57:48.357488 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 360/718] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:57:48 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:49.329109 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f734b304-abde-4d9a-9029-008d9473f923 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:49.329718 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f734b304-abde-4d9a-9029-008d9473f923 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:49.334534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:49.335593 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:49.342320 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:49.342614 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f734b304-abde-4d9a-9029-008d9473f923 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:49.343158 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f734b304-abde-4d9a-9029-008d9473f923 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:49.343466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:49.344109 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:49.344223 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f734b304-abde-4d9a-9029-008d9473f923 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:49.345132 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:49.345248 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f734b304-abde-4d9a-9029-008d9473f923 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:49.345928 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:49.346134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f734b304-abde-4d9a-9029-008d9473f923 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:49.346573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f734b304-abde-4d9a-9029-008d9473f923 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:49.346996 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:49.562395 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:49.564774 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f734b304-abde-4d9a-9029-008d9473f923 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:49.570973 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:49.572408 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:49.572866 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f734b304-abde-4d9a-9029-008d9473f923 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1729 microversion: 2.1 time: 0.248206 Sep 08 13:57:49.573431 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 359/719] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:49 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:49.573560 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-68faa3e0-b033-40e5-b0e5-8d9ebd0abf2f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1794 microversion: 2.20 time: 0.242775 Sep 08 13:57:49.574123 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 361/720] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:57:49 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1794 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:57:49.581137 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-07072d7c-7915-4c6e-8771-56caf8948dc1 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:49.583393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-07072d7c-7915-4c6e-8771-56caf8948dc1 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:49.589505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07072d7c-7915-4c6e-8771-56caf8948dc1 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:49.590150 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07072d7c-7915-4c6e-8771-56caf8948dc1 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:49.590918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07072d7c-7915-4c6e-8771-56caf8948dc1 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:49.592061 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07072d7c-7915-4c6e-8771-56caf8948dc1 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:49.592157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07072d7c-7915-4c6e-8771-56caf8948dc1 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:49.592560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-07072d7c-7915-4c6e-8771-56caf8948dc1 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:49.597259 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ec62b5c7-aea6-425b-9c63-521d37dd87b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:49.597794 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ec62b5c7-aea6-425b-9c63-521d37dd87b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:49.603918 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec62b5c7-aea6-425b-9c63-521d37dd87b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:49.604407 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec62b5c7-aea6-425b-9c63-521d37dd87b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:49.604841 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec62b5c7-aea6-425b-9c63-521d37dd87b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:49.606056 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec62b5c7-aea6-425b-9c63-521d37dd87b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:49.606516 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec62b5c7-aea6-425b-9c63-521d37dd87b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:49.606936 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec62b5c7-aea6-425b-9c63-521d37dd87b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:49.621829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-07072d7c-7915-4c6e-8771-56caf8948dc1 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046794 Sep 08 13:57:49.622397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 360/721] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:57:49 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:49.682226 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ec62b5c7-aea6-425b-9c63-521d37dd87b2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088734 Sep 08 13:57:49.682829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 362/722] 10.222.0.55 () {58 vars in 1275 bytes} [Thu Sep 8 13:57:49 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:57:50.635281 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-13caa40a-b3cc-44b9-b80d-4fb63d8f36e9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:50.638560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-13caa40a-b3cc-44b9-b80d-4fb63d8f36e9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:50.645307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13caa40a-b3cc-44b9-b80d-4fb63d8f36e9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:50.645814 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13caa40a-b3cc-44b9-b80d-4fb63d8f36e9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:50.647137 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13caa40a-b3cc-44b9-b80d-4fb63d8f36e9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:50.648429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13caa40a-b3cc-44b9-b80d-4fb63d8f36e9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:50.648885 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13caa40a-b3cc-44b9-b80d-4fb63d8f36e9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:50.649499 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13caa40a-b3cc-44b9-b80d-4fb63d8f36e9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:50.683012 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-13caa40a-b3cc-44b9-b80d-4fb63d8f36e9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053139 Sep 08 13:57:50.683690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 361/723] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:57:50 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:57:50.695748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:50.696475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:50.702691 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:50.703171 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:50.703678 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:50.704455 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:50.704975 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:50.705462 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:50.780889 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] HTTP exception thrown: Instance 6e64a0c9-b7b0-46ff-8526-88164d493140 is not attached to volume 12801054-b941-429c-979e-989ba1d4ae5b Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Request method failure captured: Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments/12801054-b941-429c-979e-989ba1d4ae5b HTTP/1.1 Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfPjN2_FT7KB9gHpqtpjdETyW1N6xUifJc80mayogb1JdsDMHXuoBJXfAH5E-HdAb7akeh_kduTIIjfHltFnhSToojv7OeK-COBawABqsg8YWYd5mp57REZ8tFTFYf6kHiGPfYzfkmjpnpICI9V0zSSDd86UBfWgHds2-ZUIsvP6R_4 Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: f7507a7da3bb4420abcfcf08780dc0a4 Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-TestMinimumBasicScenario-1765620155 Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:57:50.783328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:57:50.784675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f7507a7da3bb4420abcfcf08780dc0a4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f7507a7da3bb4420abcfcf08780dc0a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f7507a7da3bb4420abcfcf08780dc0a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f7507a7da3bb4420abcfcf08780dc0a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:57:50.784675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-TestMinimumBasicScenario-1765620155 Sep 08 13:57:50.784675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: f7507a7da3bb4420abcfcf08780dc0a4 Sep 08 13:57:50.784675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1765620155 Sep 08 13:57:50.784675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-TestMinimumBasicScenario-1765620155-project Sep 08 13:57:50.784675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:57:50.784675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:57:50.784675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: bed19e9a74be46b5bc836c3cd605133f Sep 08 13:57:50.784675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-TestMinimumBasicScenario-1765620155-project Sep 08 13:57:50.784675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:57:50.784675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 6e64a0c9-b7b0-46ff-8526-88164d493140 is not attached to volume 12801054-b941-429c-979e-989ba1d4ae5b Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'server_id': '6e64a0c9-b7b0-46ff-8526-88164d493140', 'id': '12801054-b941-429c-979e-989ba1d4ae5b'} Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 12801054-b941-429c-979e-989ba1d4ae5b. Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:57:50.785356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e64a0c9-b7b0-46ff-8526-88164d493140 is not attached to volume 12801054-b941-429c-979e-989ba1d4ae5b Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e64a0c9-b7b0-46ff-8526-88164d493140 is not attached to volume 12801054-b941-429c-979e-989ba1d4ae5b Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:57:50.786544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Returning 404 to user: Instance 6e64a0c9-b7b0-46ff-8526-88164d493140 is not attached to volume 12801054-b941-429c-979e-989ba1d4ae5b {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:57:50.787446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-342e73e7-ed90-4f34-a623-c999521061ed tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments/12801054-b941-429c-979e-989ba1d4ae5b" status: 404 len: 154 microversion: 2.1 time: 0.093690 Sep 08 13:57:50.787446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 363/724] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 13:57:50 2022] DELETE /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140/os-volume_attachments/12801054-b941-429c-979e-989ba1d4ae5b => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:57:51.305873 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a88afe1a-e97b-4c8b-af52-5975a877b6e6 req-54cd6796-2582-4053-a784-3083ad1d8a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bead64-8c72-4cb8-806b-f68b2fc593cc", "tag": "97326033-4991-4b35-9df8-8c1194e9ebe7"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:51.320791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a88afe1a-e97b-4c8b-af52-5975a877b6e6 req-54cd6796-2582-4053-a784-3083ad1d8a08 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:51.321281 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a88afe1a-e97b-4c8b-af52-5975a877b6e6 req-54cd6796-2582-4053-a784-3083ad1d8a08 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:51.322266 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a88afe1a-e97b-4c8b-af52-5975a877b6e6 req-54cd6796-2582-4053-a784-3083ad1d8a08 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:51.338186 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a88afe1a-e97b-4c8b-af52-5975a877b6e6 req-54cd6796-2582-4053-a784-3083ad1d8a08 service nova] Creating event network-changed:97326033-4991-4b35-9df8-8c1194e9ebe7 for instance 21bead64-8c72-4cb8-806b-f68b2fc593cc on hv-cinder-82002 Sep 08 13:57:51.343942 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a88afe1a-e97b-4c8b-af52-5975a877b6e6 req-54cd6796-2582-4053-a784-3083ad1d8a08 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042076 Sep 08 13:57:51.344997 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 362/725] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:51.929556 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-516adc3a-03ff-49fd-aca9-5480c687ca6d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:51.930176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-516adc3a-03ff-49fd-aca9-5480c687ca6d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:51.937128 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-516adc3a-03ff-49fd-aca9-5480c687ca6d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:51.937677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-516adc3a-03ff-49fd-aca9-5480c687ca6d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:51.938140 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-516adc3a-03ff-49fd-aca9-5480c687ca6d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:51.938819 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-516adc3a-03ff-49fd-aca9-5480c687ca6d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:51.939259 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-516adc3a-03ff-49fd-aca9-5480c687ca6d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:51.939671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-516adc3a-03ff-49fd-aca9-5480c687ca6d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:51.964304 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-516adc3a-03ff-49fd-aca9-5480c687ca6d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:57:52.037748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-516adc3a-03ff-49fd-aca9-5480c687ca6d tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 204 len: 0 microversion: 2.1 time: 0.111684 Sep 08 13:57:52.038581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 364/726] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:57:51 2022] DELETE /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:57:52.047408 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5c5c4a6d-1325-4dcf-9ea4-1a79b10fd652 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:52.048095 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5c5c4a6d-1325-4dcf-9ea4-1a79b10fd652 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:52.054707 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5c4a6d-1325-4dcf-9ea4-1a79b10fd652 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:52.055193 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5c4a6d-1325-4dcf-9ea4-1a79b10fd652 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:52.055621 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5c4a6d-1325-4dcf-9ea4-1a79b10fd652 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:52.056312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5c4a6d-1325-4dcf-9ea4-1a79b10fd652 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:52.056913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5c4a6d-1325-4dcf-9ea4-1a79b10fd652 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:52.057487 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c5c4a6d-1325-4dcf-9ea4-1a79b10fd652 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:52.331764 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5c5c4a6d-1325-4dcf-9ea4-1a79b10fd652 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:52.339611 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5c5c4a6d-1325-4dcf-9ea4-1a79b10fd652 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1554 microversion: 2.1 time: 0.296654 Sep 08 13:57:52.340684 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 363/727] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:52 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1554 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:53.363647 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d4f960e9-7b7e-4ea5-a868-68c6e19f5dc5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:53.364336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d4f960e9-7b7e-4ea5-a868-68c6e19f5dc5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:53.370616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4f960e9-7b7e-4ea5-a868-68c6e19f5dc5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:53.371084 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4f960e9-7b7e-4ea5-a868-68c6e19f5dc5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:53.371506 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4f960e9-7b7e-4ea5-a868-68c6e19f5dc5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:53.372180 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4f960e9-7b7e-4ea5-a868-68c6e19f5dc5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:53.372620 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4f960e9-7b7e-4ea5-a868-68c6e19f5dc5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:53.373032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4f960e9-7b7e-4ea5-a868-68c6e19f5dc5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:53.508749 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d4f960e9-7b7e-4ea5-a868-68c6e19f5dc5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:53.516944 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d4f960e9-7b7e-4ea5-a868-68c6e19f5dc5 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1554 microversion: 2.1 time: 0.157500 Sep 08 13:57:53.517502 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 365/728] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:53 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:53.640003 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ec81ddd9-2a89-4e96-8726-afee49170d3f req-c7d68d83-2230-4891-8162-a2a5d3c13ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bead64-8c72-4cb8-806b-f68b2fc593cc", "tag": "97326033-4991-4b35-9df8-8c1194e9ebe7"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:53.645258 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=80 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:53.650769 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ec81ddd9-2a89-4e96-8726-afee49170d3f req-c7d68d83-2230-4891-8162-a2a5d3c13ebb service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:53.651241 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ec81ddd9-2a89-4e96-8726-afee49170d3f req-c7d68d83-2230-4891-8162-a2a5d3c13ebb service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:53.651664 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ec81ddd9-2a89-4e96-8726-afee49170d3f req-c7d68d83-2230-4891-8162-a2a5d3c13ebb service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:53.662469 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ec81ddd9-2a89-4e96-8726-afee49170d3f req-c7d68d83-2230-4891-8162-a2a5d3c13ebb service nova] Creating event network-changed:97326033-4991-4b35-9df8-8c1194e9ebe7 for instance 21bead64-8c72-4cb8-806b-f68b2fc593cc on hv-cinder-82002 Sep 08 13:57:53.667165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ec81ddd9-2a89-4e96-8726-afee49170d3f req-c7d68d83-2230-4891-8162-a2a5d3c13ebb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031383 Sep 08 13:57:53.667719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 364/729] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:54.541756 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e9de2799-9338-46ec-be9a-5c0df595117c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:54.542453 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e9de2799-9338-46ec-be9a-5c0df595117c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:54.548648 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9de2799-9338-46ec-be9a-5c0df595117c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:54.549139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9de2799-9338-46ec-be9a-5c0df595117c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:54.549544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9de2799-9338-46ec-be9a-5c0df595117c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:54.550264 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9de2799-9338-46ec-be9a-5c0df595117c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:54.550724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9de2799-9338-46ec-be9a-5c0df595117c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:54.551205 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9de2799-9338-46ec-be9a-5c0df595117c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:54.686210 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e9de2799-9338-46ec-be9a-5c0df595117c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:54.693945 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e9de2799-9338-46ec-be9a-5c0df595117c tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1554 microversion: 2.1 time: 0.156074 Sep 08 13:57:54.694485 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 366/730] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:54 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:54.700837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-410812845", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-327996144", "security_groups": [{"name": "tempest-secgroup-smoke-1471578861"}], "block_device_mapping_v2": [{"uuid": "a3178dcb-e31e-40b4-818b-2fd1381d32d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "551d8846-f844-4925-a2fe-eef49820f7af"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:54.833686 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] validate_networks() for [('551d8846-f844-4925-a2fe-eef49820f7af', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:57:55.336000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:57:55.336370 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:57:55.336842 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:57:55.337245 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:57:55.337651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:57:55.347329 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:55.347807 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:55.348236 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:55.348960 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:55.349410 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:55.349860 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:55.366611 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Getting quotas for project 19d114fd258a4306b4c0665df90ae4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:57:55.370531 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Getting quotas for user 76a9dc3ddb144e599a2856fce8dc339d and project 19d114fd258a4306b4c0665df90ae4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:57:55.428853 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:57:55.431344 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3178dcb-e31e-40b4-818b-2fd1381d32d4',volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:57:55.576869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-249e2402-e35f-46e8-af13-1b8852a2a09b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.881364 Sep 08 13:57:55.581777 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 365/731] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:57:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:57:55.590196 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0bbdefa6-b9ec-46f4-99d4-27e8d55c1e4a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:55.590825 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0bbdefa6-b9ec-46f4-99d4-27e8d55c1e4a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:55.685259 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0bbdefa6-b9ec-46f4-99d4-27e8d55c1e4a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:55.692045 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0bbdefa6-b9ec-46f4-99d4-27e8d55c1e4a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1093 microversion: 2.1 time: 0.107097 Sep 08 13:57:55.692673 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 367/732] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:55 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1093 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:55.718375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6c9aa4a8-cde6-4a6a-a5f9-ef10f32c71a9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:55.719537 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6c9aa4a8-cde6-4a6a-a5f9-ef10f32c71a9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:55.726769 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c9aa4a8-cde6-4a6a-a5f9-ef10f32c71a9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:55.727472 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c9aa4a8-cde6-4a6a-a5f9-ef10f32c71a9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:55.727903 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c9aa4a8-cde6-4a6a-a5f9-ef10f32c71a9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:55.728597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c9aa4a8-cde6-4a6a-a5f9-ef10f32c71a9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:55.729044 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c9aa4a8-cde6-4a6a-a5f9-ef10f32c71a9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:55.729521 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6c9aa4a8-cde6-4a6a-a5f9-ef10f32c71a9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:55.954049 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-6c9aa4a8-cde6-4a6a-a5f9-ef10f32c71a9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:55.964490 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6c9aa4a8-cde6-4a6a-a5f9-ef10f32c71a9 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1554 microversion: 2.1 time: 0.250542 Sep 08 13:57:55.965964 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 366/733] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:55 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1554 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:56.196195 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-c25a4136-cfcd-4035-9368-bce09befda77 req-fd3ef9dc-c256-4c88-ab90-65a96539abc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e64a0c9-b7b0-46ff-8526-88164d493140", "name": "network-vif-deleted", "tag": "ca4283b0-e159-4a24-b0b2-bc113ff78694"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:56.212101 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c25a4136-cfcd-4035-9368-bce09befda77 req-fd3ef9dc-c256-4c88-ab90-65a96539abc3 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:56.213065 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c25a4136-cfcd-4035-9368-bce09befda77 req-fd3ef9dc-c256-4c88-ab90-65a96539abc3 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:56.213666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-c25a4136-cfcd-4035-9368-bce09befda77 req-fd3ef9dc-c256-4c88-ab90-65a96539abc3 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:56.225118 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-c25a4136-cfcd-4035-9368-bce09befda77 req-fd3ef9dc-c256-4c88-ab90-65a96539abc3 service nova] Creating event network-vif-deleted:ca4283b0-e159-4a24-b0b2-bc113ff78694 for instance 6e64a0c9-b7b0-46ff-8526-88164d493140 on hv-cinder-82002 Sep 08 13:57:56.234053 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-c25a4136-cfcd-4035-9368-bce09befda77 req-fd3ef9dc-c256-4c88-ab90-65a96539abc3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044135 Sep 08 13:57:56.234758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 368/734] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:56.715429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-600b61b4-f50a-48c6-aff5-064ad732acc5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:56.716043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-600b61b4-f50a-48c6-aff5-064ad732acc5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:56.722590 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600b61b4-f50a-48c6-aff5-064ad732acc5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:56.723159 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600b61b4-f50a-48c6-aff5-064ad732acc5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:56.723534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600b61b4-f50a-48c6-aff5-064ad732acc5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:56.724234 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600b61b4-f50a-48c6-aff5-064ad732acc5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:56.724682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600b61b4-f50a-48c6-aff5-064ad732acc5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:56.725135 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-600b61b4-f50a-48c6-aff5-064ad732acc5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:56.729319 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:56.802419 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-600b61b4-f50a-48c6-aff5-064ad732acc5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:56.809957 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-600b61b4-f50a-48c6-aff5-064ad732acc5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1135 microversion: 2.1 time: 0.099295 Sep 08 13:57:56.810523 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 367/735] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:56 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1135 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:56.990061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:56.990893 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:56.997597 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:56.998295 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:56.998894 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:56.999641 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:57.000151 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:57.000669 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:57.033121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:57.033600 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:57.034058 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:57.034545 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lazy-loading 'fault' on Instance uuid 6e64a0c9-b7b0-46ff-8526-88164d493140 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:57:57.075914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed19e9a74be46b5bc836c3cd605133f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7507a7da3bb4420abcfcf08780dc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:57.083904 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ced44346-4709-4c80-8cc8-fdd4c8cc9251 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 200 len: 1347 microversion: 2.1 time: 0.098966 Sep 08 13:57:57.084471 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 369/736] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:56 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 1347 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:57.832428 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b74fd67f-3189-4181-bdc3-36dd9b37f5ef tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:57.832977 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b74fd67f-3189-4181-bdc3-36dd9b37f5ef tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:57.839565 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b74fd67f-3189-4181-bdc3-36dd9b37f5ef tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:57.840049 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b74fd67f-3189-4181-bdc3-36dd9b37f5ef tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:57.840493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b74fd67f-3189-4181-bdc3-36dd9b37f5ef tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:57.841184 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b74fd67f-3189-4181-bdc3-36dd9b37f5ef tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:57.841642 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b74fd67f-3189-4181-bdc3-36dd9b37f5ef tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:57.842123 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b74fd67f-3189-4181-bdc3-36dd9b37f5ef tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:57.902450 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b74fd67f-3189-4181-bdc3-36dd9b37f5ef tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:57.910344 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b74fd67f-3189-4181-bdc3-36dd9b37f5ef tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1191 microversion: 2.1 time: 0.081615 Sep 08 13:57:57.910844 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 368/737] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:57 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:58.109041 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:58.109680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] [instance: 6e64a0c9-b7b0-46ff-8526-88164d493140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:58.115623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:58.116173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:58.116673 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:58.117426 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:58.117905 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:58.118323 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:58.131677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] HTTP exception thrown: Instance 6e64a0c9-b7b0-46ff-8526-88164d493140 could not be found. Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Request method failure captured: Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 HTTP/1.1 Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfPjN2_FT7KB9gHpqtpjdETyW1N6xUifJc80mayogb1JdsDMHXuoBJXfAH5E-HdAb7akeh_kduTIIjfHltFnhSToojv7OeK-COBawABqsg8YWYd5mp57REZ8tFTFYf6kHiGPfYzfkmjpnpICI9V0zSSDd86UBfWgHds2-ZUIsvP6R_4 Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: f7507a7da3bb4420abcfcf08780dc0a4 Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-TestMinimumBasicScenario-1765620155 Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:57:58.133381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f7507a7da3bb4420abcfcf08780dc0a4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f7507a7da3bb4420abcfcf08780dc0a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f7507a7da3bb4420abcfcf08780dc0a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f7507a7da3bb4420abcfcf08780dc0a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-TestMinimumBasicScenario-1765620155 Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: f7507a7da3bb4420abcfcf08780dc0a4 Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1765620155 Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-TestMinimumBasicScenario-1765620155-project Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: bed19e9a74be46b5bc836c3cd605133f Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-TestMinimumBasicScenario-1765620155-project Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 6e64a0c9-b7b0-46ff-8526-88164d493140 could not be found. Sep 08 13:57:58.135166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '6e64a0c9-b7b0-46ff-8526-88164d493140'} Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e64a0c9-b7b0-46ff-8526-88164d493140 could not be found. Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:57:58.135972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e64a0c9-b7b0-46ff-8526-88164d493140 could not be found. Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e64a0c9-b7b0-46ff-8526-88164d493140 could not be found. Sep 08 13:57:58.137266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:57:58.138500 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Returning 404 to user: Instance 6e64a0c9-b7b0-46ff-8526-88164d493140 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:57:58.138500 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3970d196-d1e9-4cc0-81ec-45c2c36a86fe tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140" status: 404 len: 111 microversion: 2.1 time: 0.030699 Sep 08 13:57:58.138500 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 370/738] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:58 2022] GET /compute/v2.1/servers/6e64a0c9-b7b0-46ff-8526-88164d493140 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:57:58.145176 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-acdf4cc0-467e-4278-9770-4f1989ae82a6 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] Calling method '.version_select at 0x7f5be45119d0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:58.166892 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-acdf4cc0-467e-4278-9770-4f1989ae82a6 tempest-TestMinimumBasicScenario-1765620155 tempest-TestMinimumBasicScenario-1765620155-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-789751874" status: 202 len: 0 microversion: 2.1 time: 0.026430 Sep 08 13:57:58.167462 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 369/739] 10.222.0.55 () {58 vars in 1269 bytes} [Thu Sep 8 13:57:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-789751874 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:57:58.932619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9f0806eb-1667-45a6-97f2-72f90c3a8c0b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:58.933681 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9f0806eb-1667-45a6-97f2-72f90c3a8c0b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:58.939626 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f0806eb-1667-45a6-97f2-72f90c3a8c0b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:58.940369 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f0806eb-1667-45a6-97f2-72f90c3a8c0b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:58.941120 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f0806eb-1667-45a6-97f2-72f90c3a8c0b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:58.942074 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f0806eb-1667-45a6-97f2-72f90c3a8c0b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:58.942740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f0806eb-1667-45a6-97f2-72f90c3a8c0b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:58.943351 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9f0806eb-1667-45a6-97f2-72f90c3a8c0b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:59.158294 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9f0806eb-1667-45a6-97f2-72f90c3a8c0b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:59.166235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9f0806eb-1667-45a6-97f2-72f90c3a8c0b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1277 microversion: 2.1 time: 0.237410 Sep 08 13:57:59.169093 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 371/740] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:58 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:59.914271 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-5e61cd9f-9ea1-4964-9d6f-6017309e5143 req-c08dbc96-3522-45da-b115-2d7c194b45e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335efb35-9bac-46a5-b2d4-4e2936c82aaf", "tag": "f0cab8b5-a76d-4e29-b91b-c60d3fdf2858"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:59.926088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5e61cd9f-9ea1-4964-9d6f-6017309e5143 req-c08dbc96-3522-45da-b115-2d7c194b45e6 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:59.926940 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5e61cd9f-9ea1-4964-9d6f-6017309e5143 req-c08dbc96-3522-45da-b115-2d7c194b45e6 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:59.927375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-5e61cd9f-9ea1-4964-9d6f-6017309e5143 req-c08dbc96-3522-45da-b115-2d7c194b45e6 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:59.939936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-5e61cd9f-9ea1-4964-9d6f-6017309e5143 req-c08dbc96-3522-45da-b115-2d7c194b45e6 service nova] Creating event network-changed:f0cab8b5-a76d-4e29-b91b-c60d3fdf2858 for instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf on hv-cinder-82002 Sep 08 13:57:59.946540 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-5e61cd9f-9ea1-4964-9d6f-6017309e5143 req-c08dbc96-3522-45da-b115-2d7c194b45e6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038028 Sep 08 13:57:59.947448 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 370/741] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:00.192097 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c4ad9251-f348-4c0b-8e75-9b8804b87b47 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:00.192613 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c4ad9251-f348-4c0b-8e75-9b8804b87b47 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:00.199606 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4ad9251-f348-4c0b-8e75-9b8804b87b47 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:00.200358 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4ad9251-f348-4c0b-8e75-9b8804b87b47 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:00.200789 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4ad9251-f348-4c0b-8e75-9b8804b87b47 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:00.201585 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4ad9251-f348-4c0b-8e75-9b8804b87b47 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:00.201944 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4ad9251-f348-4c0b-8e75-9b8804b87b47 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:00.202361 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c4ad9251-f348-4c0b-8e75-9b8804b87b47 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:00.406336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c4ad9251-f348-4c0b-8e75-9b8804b87b47 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:00.415170 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c4ad9251-f348-4c0b-8e75-9b8804b87b47 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1265 microversion: 2.1 time: 0.226971 Sep 08 13:58:00.415971 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 372/742] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:00 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:01.439639 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ce1ff8c7-c97d-4cc9-9edb-f6016dd77be3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:01.440486 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ce1ff8c7-c97d-4cc9-9edb-f6016dd77be3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:01.447458 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce1ff8c7-c97d-4cc9-9edb-f6016dd77be3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:01.447964 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce1ff8c7-c97d-4cc9-9edb-f6016dd77be3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:01.448592 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce1ff8c7-c97d-4cc9-9edb-f6016dd77be3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:01.449920 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce1ff8c7-c97d-4cc9-9edb-f6016dd77be3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:01.451187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce1ff8c7-c97d-4cc9-9edb-f6016dd77be3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:01.451614 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce1ff8c7-c97d-4cc9-9edb-f6016dd77be3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:01.601611 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ce1ff8c7-c97d-4cc9-9edb-f6016dd77be3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:01.609702 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ce1ff8c7-c97d-4cc9-9edb-f6016dd77be3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1265 microversion: 2.1 time: 0.174224 Sep 08 13:58:01.610485 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 371/743] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:01 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:02.632196 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d7ec74f9-34e9-4304-8a40-c75e1588ec11 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:02.632809 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d7ec74f9-34e9-4304-8a40-c75e1588ec11 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:02.635479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:02.641151 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ec74f9-34e9-4304-8a40-c75e1588ec11 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:02.641631 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ec74f9-34e9-4304-8a40-c75e1588ec11 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:02.642112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ec74f9-34e9-4304-8a40-c75e1588ec11 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:02.642858 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ec74f9-34e9-4304-8a40-c75e1588ec11 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:02.643317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ec74f9-34e9-4304-8a40-c75e1588ec11 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:02.643736 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d7ec74f9-34e9-4304-8a40-c75e1588ec11 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:02.913864 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d7ec74f9-34e9-4304-8a40-c75e1588ec11 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:02.921440 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d7ec74f9-34e9-4304-8a40-c75e1588ec11 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1265 microversion: 2.1 time: 0.293066 Sep 08 13:58:02.922042 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 373/744] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:02 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:03.944478 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7483191e-02f5-404a-b824-486350f51ef6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:03.945881 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7483191e-02f5-404a-b824-486350f51ef6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:03.953250 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7483191e-02f5-404a-b824-486350f51ef6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:03.953765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7483191e-02f5-404a-b824-486350f51ef6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:03.954208 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7483191e-02f5-404a-b824-486350f51ef6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:03.954923 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7483191e-02f5-404a-b824-486350f51ef6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:03.955593 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7483191e-02f5-404a-b824-486350f51ef6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:03.956026 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7483191e-02f5-404a-b824-486350f51ef6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:04.173424 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7483191e-02f5-404a-b824-486350f51ef6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:04.181199 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7483191e-02f5-404a-b824-486350f51ef6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1265 microversion: 2.1 time: 0.240524 Sep 08 13:58:04.182218 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 372/745] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:03 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:05.204911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7f67a824-2409-414d-a65f-d024b2db4c69 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:05.206020 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7f67a824-2409-414d-a65f-d024b2db4c69 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:05.212619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f67a824-2409-414d-a65f-d024b2db4c69 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:05.213179 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f67a824-2409-414d-a65f-d024b2db4c69 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:05.213703 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f67a824-2409-414d-a65f-d024b2db4c69 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:05.215566 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f67a824-2409-414d-a65f-d024b2db4c69 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:05.216021 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f67a824-2409-414d-a65f-d024b2db4c69 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:05.216445 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f67a824-2409-414d-a65f-d024b2db4c69 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:05.468520 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7f67a824-2409-414d-a65f-d024b2db4c69 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:05.477235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7f67a824-2409-414d-a65f-d024b2db4c69 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1265 microversion: 2.1 time: 0.276173 Sep 08 13:58:05.489991 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 374/746] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:05 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:06.500994 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf5ec2ad-3bd8-470a-a209-acfd00fa18f0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:06.501646 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bf5ec2ad-3bd8-470a-a209-acfd00fa18f0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:06.504094 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:06.504763 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:06.510979 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf5ec2ad-3bd8-470a-a209-acfd00fa18f0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:06.511578 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf5ec2ad-3bd8-470a-a209-acfd00fa18f0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:06.512530 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf5ec2ad-3bd8-470a-a209-acfd00fa18f0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:06.513225 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf5ec2ad-3bd8-470a-a209-acfd00fa18f0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:06.513667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf5ec2ad-3bd8-470a-a209-acfd00fa18f0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:06.514109 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf5ec2ad-3bd8-470a-a209-acfd00fa18f0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:06.658637 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf5ec2ad-3bd8-470a-a209-acfd00fa18f0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:06.666394 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf5ec2ad-3bd8-470a-a209-acfd00fa18f0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1265 microversion: 2.1 time: 0.169267 Sep 08 13:58:06.666969 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 373/747] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:06 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:07.688808 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3dcfd7e8-615c-4e13-a54f-fe8e18914f83 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:07.689417 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3dcfd7e8-615c-4e13-a54f-fe8e18914f83 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:07.691322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:07.696975 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dcfd7e8-615c-4e13-a54f-fe8e18914f83 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:07.697486 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dcfd7e8-615c-4e13-a54f-fe8e18914f83 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:07.697954 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dcfd7e8-615c-4e13-a54f-fe8e18914f83 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:07.698643 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dcfd7e8-615c-4e13-a54f-fe8e18914f83 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:07.699656 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dcfd7e8-615c-4e13-a54f-fe8e18914f83 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:07.700083 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3dcfd7e8-615c-4e13-a54f-fe8e18914f83 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:07.830141 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3dcfd7e8-615c-4e13-a54f-fe8e18914f83 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:07.837870 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3dcfd7e8-615c-4e13-a54f-fe8e18914f83 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1265 microversion: 2.1 time: 0.152839 Sep 08 13:58:07.838435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 375/748] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:07 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:08.860747 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f318117-04ff-4bd2-84d3-ee71f2167921 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:08.861257 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f318117-04ff-4bd2-84d3-ee71f2167921 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:08.868430 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f318117-04ff-4bd2-84d3-ee71f2167921 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:08.868979 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f318117-04ff-4bd2-84d3-ee71f2167921 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:08.869419 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f318117-04ff-4bd2-84d3-ee71f2167921 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:08.870152 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f318117-04ff-4bd2-84d3-ee71f2167921 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:08.870611 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f318117-04ff-4bd2-84d3-ee71f2167921 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:08.871055 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f318117-04ff-4bd2-84d3-ee71f2167921 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:09.008138 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3f318117-04ff-4bd2-84d3-ee71f2167921 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:09.016181 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f318117-04ff-4bd2-84d3-ee71f2167921 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1265 microversion: 2.1 time: 0.159324 Sep 08 13:58:09.016740 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 374/749] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:08 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:10.039300 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6afd8669-0646-43a3-873a-27285d12e2d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:10.039912 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6afd8669-0646-43a3-873a-27285d12e2d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:10.046797 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6afd8669-0646-43a3-873a-27285d12e2d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:10.047271 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6afd8669-0646-43a3-873a-27285d12e2d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:10.047712 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6afd8669-0646-43a3-873a-27285d12e2d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:10.048402 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6afd8669-0646-43a3-873a-27285d12e2d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:10.048827 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6afd8669-0646-43a3-873a-27285d12e2d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:10.049243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6afd8669-0646-43a3-873a-27285d12e2d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:10.053064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:10.181542 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6afd8669-0646-43a3-873a-27285d12e2d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:10.189168 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6afd8669-0646-43a3-873a-27285d12e2d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1265 microversion: 2.1 time: 0.153805 Sep 08 13:58:10.189727 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 376/750] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:10 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:11.210976 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5c17602a-bb7e-4bcd-8043-d3d1bfa7a1c7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:11.211531 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5c17602a-bb7e-4bcd-8043-d3d1bfa7a1c7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:11.218188 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c17602a-bb7e-4bcd-8043-d3d1bfa7a1c7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:11.218670 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c17602a-bb7e-4bcd-8043-d3d1bfa7a1c7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:11.219099 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c17602a-bb7e-4bcd-8043-d3d1bfa7a1c7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:11.219789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c17602a-bb7e-4bcd-8043-d3d1bfa7a1c7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:11.220235 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c17602a-bb7e-4bcd-8043-d3d1bfa7a1c7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:11.220650 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5c17602a-bb7e-4bcd-8043-d3d1bfa7a1c7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:11.258232 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e78e9de5-66fd-42f7-9638-5c14f1912397 req-d021c3db-a99d-4ac8-8159-41fe91e193d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335efb35-9bac-46a5-b2d4-4e2936c82aaf", "name": "network-vif-plugged", "status": "completed", "tag": "f0cab8b5-a76d-4e29-b91b-c60d3fdf2858"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:11.268058 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e78e9de5-66fd-42f7-9638-5c14f1912397 req-d021c3db-a99d-4ac8-8159-41fe91e193d9 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:11.268532 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e78e9de5-66fd-42f7-9638-5c14f1912397 req-d021c3db-a99d-4ac8-8159-41fe91e193d9 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:11.268957 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e78e9de5-66fd-42f7-9638-5c14f1912397 req-d021c3db-a99d-4ac8-8159-41fe91e193d9 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:11.280767 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e78e9de5-66fd-42f7-9638-5c14f1912397 req-d021c3db-a99d-4ac8-8159-41fe91e193d9 service nova] Creating event network-vif-plugged:f0cab8b5-a76d-4e29-b91b-c60d3fdf2858 for instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf on hv-cinder-82002 Sep 08 13:58:11.285822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e78e9de5-66fd-42f7-9638-5c14f1912397 req-d021c3db-a99d-4ac8-8159-41fe91e193d9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031092 Sep 08 13:58:11.286664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 377/751] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:58:11.357635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5c17602a-bb7e-4bcd-8043-d3d1bfa7a1c7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:11.365867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5c17602a-bb7e-4bcd-8043-d3d1bfa7a1c7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1265 microversion: 2.1 time: 0.158693 Sep 08 13:58:11.366533 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 375/752] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:11 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:12.391136 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c6580eba-490e-4954-8835-ac535addbd93 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:12.391834 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c6580eba-490e-4954-8835-ac535addbd93 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:12.397937 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6580eba-490e-4954-8835-ac535addbd93 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:12.398420 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6580eba-490e-4954-8835-ac535addbd93 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:12.398857 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6580eba-490e-4954-8835-ac535addbd93 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:12.399548 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6580eba-490e-4954-8835-ac535addbd93 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:12.399998 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6580eba-490e-4954-8835-ac535addbd93 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:12.400418 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c6580eba-490e-4954-8835-ac535addbd93 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:12.531060 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c6580eba-490e-4954-8835-ac535addbd93 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:12.538948 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c6580eba-490e-4954-8835-ac535addbd93 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1265 microversion: 2.1 time: 0.153057 Sep 08 13:58:12.539521 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 378/753] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:12 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:13.561510 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-412f16ac-d9f1-4a7c-a654-2379c03b70cc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:13.562157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-412f16ac-d9f1-4a7c-a654-2379c03b70cc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:13.568689 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-412f16ac-d9f1-4a7c-a654-2379c03b70cc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:13.569196 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-412f16ac-d9f1-4a7c-a654-2379c03b70cc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:13.569631 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-412f16ac-d9f1-4a7c-a654-2379c03b70cc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:13.570359 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-412f16ac-d9f1-4a7c-a654-2379c03b70cc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:13.570811 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-412f16ac-d9f1-4a7c-a654-2379c03b70cc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:13.571233 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-412f16ac-d9f1-4a7c-a654-2379c03b70cc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:13.701723 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-412f16ac-d9f1-4a7c-a654-2379c03b70cc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:13.709382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-412f16ac-d9f1-4a7c-a654-2379c03b70cc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1451 microversion: 2.1 time: 0.151740 Sep 08 13:58:13.709975 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 376/754] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:13 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:13.732646 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b884ac96-0617-4a16-97b4-3f3ab4ca4a61 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:13.733247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b884ac96-0617-4a16-97b4-3f3ab4ca4a61 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:13.739503 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b884ac96-0617-4a16-97b4-3f3ab4ca4a61 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:13.739975 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b884ac96-0617-4a16-97b4-3f3ab4ca4a61 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:13.740403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b884ac96-0617-4a16-97b4-3f3ab4ca4a61 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:13.741078 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b884ac96-0617-4a16-97b4-3f3ab4ca4a61 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:13.741522 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b884ac96-0617-4a16-97b4-3f3ab4ca4a61 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:13.741969 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b884ac96-0617-4a16-97b4-3f3ab4ca4a61 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:13.872701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b884ac96-0617-4a16-97b4-3f3ab4ca4a61 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:13.880298 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b884ac96-0617-4a16-97b4-3f3ab4ca4a61 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1451 microversion: 2.1 time: 0.152334 Sep 08 13:58:13.880845 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 379/755] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:13 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:15.991024 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-eba314cb-dd68-447f-90d7-15b615e34acf req-334b35c8-7d49-4ae8-b97c-da7e14fa7645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335efb35-9bac-46a5-b2d4-4e2936c82aaf", "tag": "f0cab8b5-a76d-4e29-b91b-c60d3fdf2858"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:16.000549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eba314cb-dd68-447f-90d7-15b615e34acf req-334b35c8-7d49-4ae8-b97c-da7e14fa7645 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:16.001056 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eba314cb-dd68-447f-90d7-15b615e34acf req-334b35c8-7d49-4ae8-b97c-da7e14fa7645 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:16.001489 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-eba314cb-dd68-447f-90d7-15b615e34acf req-334b35c8-7d49-4ae8-b97c-da7e14fa7645 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:16.013006 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-eba314cb-dd68-447f-90d7-15b615e34acf req-334b35c8-7d49-4ae8-b97c-da7e14fa7645 service nova] Creating event network-changed:f0cab8b5-a76d-4e29-b91b-c60d3fdf2858 for instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf on hv-cinder-82002 Sep 08 13:58:16.018081 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-eba314cb-dd68-447f-90d7-15b615e34acf req-334b35c8-7d49-4ae8-b97c-da7e14fa7645 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154709 Sep 08 13:58:16.018669 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 377/756] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:30.759246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=13 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:30.759985 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=19 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:30.865050 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-79b2a58d-74dc-4d35-a0bc-b9964a227512 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:30.865545 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-79b2a58d-74dc-4d35-a0bc-b9964a227512 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:30.871457 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79b2a58d-74dc-4d35-a0bc-b9964a227512 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:30.871935 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79b2a58d-74dc-4d35-a0bc-b9964a227512 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:30.872365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79b2a58d-74dc-4d35-a0bc-b9964a227512 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:30.873535 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79b2a58d-74dc-4d35-a0bc-b9964a227512 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:30.874014 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79b2a58d-74dc-4d35-a0bc-b9964a227512 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:30.874433 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-79b2a58d-74dc-4d35-a0bc-b9964a227512 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:30.897526 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-79b2a58d-74dc-4d35-a0bc-b9964a227512 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/ips" status: 200 len: 150 microversion: 2.1 time: 0.143316 Sep 08 13:58:30.898109 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 380/757] 10.222.0.55 () {58 vars in 1248 bytes} [Thu Sep 8 13:58:30 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/ips => generated 150 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:32.220987 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:32.221864 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=50 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:32.226141 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c6b9af89-c68e-4d79-9231-e1632f6f1fc6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "197857d8-858e-41ad-ac57-5add8ce1c6ef"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:32.228610 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c6b9af89-c68e-4d79-9231-e1632f6f1fc6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:32.236008 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6b9af89-c68e-4d79-9231-e1632f6f1fc6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:32.236489 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6b9af89-c68e-4d79-9231-e1632f6f1fc6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:32.236931 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6b9af89-c68e-4d79-9231-e1632f6f1fc6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:32.237625 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6b9af89-c68e-4d79-9231-e1632f6f1fc6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:32.238116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6b9af89-c68e-4d79-9231-e1632f6f1fc6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:32.238541 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c6b9af89-c68e-4d79-9231-e1632f6f1fc6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:32.524040 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c6b9af89-c68e-4d79-9231-e1632f6f1fc6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304408 Sep 08 13:58:32.525056 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 378/758] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 13:58:32 2022] POST /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:58:35.349619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-48758310-4322-4066-b73d-c3e6268e48cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:35.351908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-48758310-4322-4066-b73d-c3e6268e48cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:35.358571 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48758310-4322-4066-b73d-c3e6268e48cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:35.359052 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48758310-4322-4066-b73d-c3e6268e48cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:35.359482 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48758310-4322-4066-b73d-c3e6268e48cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:35.360165 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48758310-4322-4066-b73d-c3e6268e48cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:35.360614 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48758310-4322-4066-b73d-c3e6268e48cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:35.361068 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-48758310-4322-4066-b73d-c3e6268e48cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:35.389999 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-48758310-4322-4066-b73d-c3e6268e48cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044298 Sep 08 13:58:35.390537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 381/759] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:35 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:58:35.452415 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f900e455-b502-4717-862b-bb3d0d27a729 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:35.452987 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f900e455-b502-4717-862b-bb3d0d27a729 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:35.459465 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f900e455-b502-4717-862b-bb3d0d27a729 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:35.459934 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f900e455-b502-4717-862b-bb3d0d27a729 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:35.460361 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f900e455-b502-4717-862b-bb3d0d27a729 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:35.461039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f900e455-b502-4717-862b-bb3d0d27a729 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:35.461486 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f900e455-b502-4717-862b-bb3d0d27a729 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:35.461933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f900e455-b502-4717-862b-bb3d0d27a729 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:35.486033 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f900e455-b502-4717-862b-bb3d0d27a729 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:58:35.559317 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f900e455-b502-4717-862b-bb3d0d27a729 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 204 len: 0 microversion: 2.1 time: 0.111452 Sep 08 13:58:35.563505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 379/760] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:58:35 2022] DELETE /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:58:35.571165 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3861d954-e22a-4c32-8d51-563f5345c555 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:35.571781 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3861d954-e22a-4c32-8d51-563f5345c555 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:35.578345 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3861d954-e22a-4c32-8d51-563f5345c555 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:35.579479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3861d954-e22a-4c32-8d51-563f5345c555 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:35.579918 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3861d954-e22a-4c32-8d51-563f5345c555 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:35.580626 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3861d954-e22a-4c32-8d51-563f5345c555 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:35.581067 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3861d954-e22a-4c32-8d51-563f5345c555 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:35.581489 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3861d954-e22a-4c32-8d51-563f5345c555 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:35.711613 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3861d954-e22a-4c32-8d51-563f5345c555 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:35.719428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3861d954-e22a-4c32-8d51-563f5345c555 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1672 microversion: 2.1 time: 0.153759 Sep 08 13:58:35.719985 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 382/761] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:35 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:36.743238 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-58bc6b0f-e7de-461a-b867-69436844e2c3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:36.743897 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-58bc6b0f-e7de-461a-b867-69436844e2c3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:36.750273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58bc6b0f-e7de-461a-b867-69436844e2c3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:36.750761 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58bc6b0f-e7de-461a-b867-69436844e2c3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:36.751202 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58bc6b0f-e7de-461a-b867-69436844e2c3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:36.751889 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58bc6b0f-e7de-461a-b867-69436844e2c3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:36.752343 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58bc6b0f-e7de-461a-b867-69436844e2c3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:36.752768 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-58bc6b0f-e7de-461a-b867-69436844e2c3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:36.892841 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-58bc6b0f-e7de-461a-b867-69436844e2c3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:36.900455 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-58bc6b0f-e7de-461a-b867-69436844e2c3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1672 microversion: 2.1 time: 0.161556 Sep 08 13:58:36.901020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 380/762] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:36 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:37.927676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e1b3de6d-6259-4dea-9df9-21c5fa5494fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:37.928284 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e1b3de6d-6259-4dea-9df9-21c5fa5494fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:37.936598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b3de6d-6259-4dea-9df9-21c5fa5494fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:37.936598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b3de6d-6259-4dea-9df9-21c5fa5494fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:37.936883 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b3de6d-6259-4dea-9df9-21c5fa5494fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:37.937801 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b3de6d-6259-4dea-9df9-21c5fa5494fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:37.938358 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b3de6d-6259-4dea-9df9-21c5fa5494fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:37.938779 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e1b3de6d-6259-4dea-9df9-21c5fa5494fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:38.125262 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e1b3de6d-6259-4dea-9df9-21c5fa5494fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:38.132821 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e1b3de6d-6259-4dea-9df9-21c5fa5494fc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1672 microversion: 2.1 time: 0.209045 Sep 08 13:58:38.133390 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 383/763] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:37 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1672 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:38.512725 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-f5313e0c-aeb3-4f54-84f3-81a261d1282f req-db456a71-0296-4ba6-acc3-08dc417d0954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ad7906-3b73-4fc9-a692-9692fb6234b3", "name": "network-vif-deleted", "tag": "86699af9-4b49-40e3-b189-ff4a7a9e5e59"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:38.528716 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f5313e0c-aeb3-4f54-84f3-81a261d1282f req-db456a71-0296-4ba6-acc3-08dc417d0954 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:38.529465 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f5313e0c-aeb3-4f54-84f3-81a261d1282f req-db456a71-0296-4ba6-acc3-08dc417d0954 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:38.530161 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-f5313e0c-aeb3-4f54-84f3-81a261d1282f req-db456a71-0296-4ba6-acc3-08dc417d0954 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:38.543202 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-f5313e0c-aeb3-4f54-84f3-81a261d1282f req-db456a71-0296-4ba6-acc3-08dc417d0954 service nova] Creating event network-vif-deleted:86699af9-4b49-40e3-b189-ff4a7a9e5e59 for instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 on hv-cinder-82002 Sep 08 13:58:38.548543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-f5313e0c-aeb3-4f54-84f3-81a261d1282f req-db456a71-0296-4ba6-acc3-08dc417d0954 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096445 Sep 08 13:58:38.549788 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 381/764] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:38.758113 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7e44d4fc-9385-4778-b3cf-ec5af54e6db4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:38.758803 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7e44d4fc-9385-4778-b3cf-ec5af54e6db4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:38.764960 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e44d4fc-9385-4778-b3cf-ec5af54e6db4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:38.765537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e44d4fc-9385-4778-b3cf-ec5af54e6db4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:38.766086 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e44d4fc-9385-4778-b3cf-ec5af54e6db4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:38.766843 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e44d4fc-9385-4778-b3cf-ec5af54e6db4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:38.767429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e44d4fc-9385-4778-b3cf-ec5af54e6db4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:38.767856 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7e44d4fc-9385-4778-b3cf-ec5af54e6db4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:38.796761 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7e44d4fc-9385-4778-b3cf-ec5af54e6db4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments/7ea4892f-6042-4852-a87a-29440ff5ee57" status: 200 len: 194 microversion: 2.20 time: 0.042697 Sep 08 13:58:38.797335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 384/765] 10.222.0.55 () {60 vars in 1454 bytes} [Thu Sep 8 13:58:38 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments/7ea4892f-6042-4852-a87a-29440ff5ee57 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:58:38.866586 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-67786687-21d4-406a-855c-d8760e26de65 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:38.867155 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-67786687-21d4-406a-855c-d8760e26de65 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:38.873666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67786687-21d4-406a-855c-d8760e26de65 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:38.874176 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67786687-21d4-406a-855c-d8760e26de65 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:38.874606 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67786687-21d4-406a-855c-d8760e26de65 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:38.875288 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67786687-21d4-406a-855c-d8760e26de65 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:38.875734 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67786687-21d4-406a-855c-d8760e26de65 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:38.876156 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-67786687-21d4-406a-855c-d8760e26de65 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:38.966833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-67786687-21d4-406a-855c-d8760e26de65 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lazy-loading 'services' on Instance uuid efdb4c65-ed8d-4792-ac96-8b1053b167b5 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:39.035805 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-67786687-21d4-406a-855c-d8760e26de65 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "DELETE /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments/7ea4892f-6042-4852-a87a-29440ff5ee57" status: 202 len: 0 microversion: 2.20 time: 0.173242 Sep 08 13:58:39.036396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 382/766] 10.222.0.55 () {60 vars in 1457 bytes} [Thu Sep 8 13:58:38 2022] DELETE /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments/7ea4892f-6042-4852-a87a-29440ff5ee57 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:58:39.045242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a83cb452-c310-4268-a5a6-8eee6eb7f9a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:39.047408 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a83cb452-c310-4268-a5a6-8eee6eb7f9a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:39.053708 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83cb452-c310-4268-a5a6-8eee6eb7f9a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:39.054674 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83cb452-c310-4268-a5a6-8eee6eb7f9a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:39.054674 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83cb452-c310-4268-a5a6-8eee6eb7f9a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:39.055307 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83cb452-c310-4268-a5a6-8eee6eb7f9a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:39.055760 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83cb452-c310-4268-a5a6-8eee6eb7f9a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:39.056179 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83cb452-c310-4268-a5a6-8eee6eb7f9a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:39.085094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a83cb452-c310-4268-a5a6-8eee6eb7f9a2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044345 Sep 08 13:58:39.085651 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 385/767] 10.222.0.55 () {60 vars in 1343 bytes} [Thu Sep 8 13:58:39 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:58:39.159839 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:39.160627 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:39.170356 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:39.170898 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:39.171548 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:39.172320 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:39.172777 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:39.173202 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:39.205212 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:39.205537 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:39.206007 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:39.206459 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lazy-loading 'fault' on Instance uuid d2ad7906-3b73-4fc9-a692-9692fb6234b3 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:39.266354 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:39.274612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2ddaa938-e413-4aa0-a111-7c7542d86862 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1326 microversion: 2.1 time: 0.118966 Sep 08 13:58:39.275719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 383/768] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:39 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1326 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:40.069063 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "197857d8-858e-41ad-ac57-5add8ce1c6ef"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:40.071385 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:40.078419 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:40.078892 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:40.079318 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:40.079993 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:40.080435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:40.080846 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:40.098019 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a3943ee1-e9e6-411f-9ad8-57d5c9b3c5a4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:40.100197 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3943ee1-e9e6-411f-9ad8-57d5c9b3c5a4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:40.106511 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3943ee1-e9e6-411f-9ad8-57d5c9b3c5a4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:40.107543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3943ee1-e9e6-411f-9ad8-57d5c9b3c5a4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:40.107974 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3943ee1-e9e6-411f-9ad8-57d5c9b3c5a4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:40.108677 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3943ee1-e9e6-411f-9ad8-57d5c9b3c5a4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:40.109128 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3943ee1-e9e6-411f-9ad8-57d5c9b3c5a4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:40.109551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3943ee1-e9e6-411f-9ad8-57d5c9b3c5a4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:40.139422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a3943ee1-e9e6-411f-9ad8-57d5c9b3c5a4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045362 Sep 08 13:58:40.139998 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 384/769] 10.222.0.55 () {60 vars in 1343 bytes} [Thu Sep 8 13:58:40 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:58:40.165508 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Invalid volume: volume 197857d8-858e-41ad-ac57-5add8ce1c6ef is already attached to instances: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: POST /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments HTTP/1.1 Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 74 Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:58:40.167251 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {"volumeAttachment": {"volumeId": "197857d8-858e-41ad-ac57-5add8ce1c6ef"}} Sep 08 13:58:40.168755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Invalid volume: volume 197857d8-858e-41ad-ac57-5add8ce1c6ef is already attached to instances: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'server_id': '30b6fbb8-a2c9-4c92-b120-8ea3259c9b56', 'body': {'volumeAttachment': {'volumeId': '197857d8-858e-41ad-ac57-5add8ce1c6ef'}}} Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 197857d8-858e-41ad-ac57-5add8ce1c6ef is already attached to instances: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:40.173397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 197857d8-858e-41ad-ac57-5add8ce1c6ef is already attached to instances: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:40.174701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:40.176127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:40.176127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:58:40.176127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:58:40.176127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 197857d8-858e-41ad-ac57-5add8ce1c6ef is already attached to instances: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 Sep 08 13:58:40.176127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:40.176127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 400 to user: Invalid volume: volume 197857d8-858e-41ad-ac57-5add8ce1c6ef is already attached to instances: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:58:40.176127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a1ca59e1-c080-428f-baf9-323a6331a3fc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103667 Sep 08 13:58:40.176127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 386/770] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 13:58:40 2022] POST /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:58:40.242009 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-77dbf0de-052e-4736-baee-0da84b4a2e39 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:40.242504 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-77dbf0de-052e-4736-baee-0da84b4a2e39 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:40.248922 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77dbf0de-052e-4736-baee-0da84b4a2e39 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:40.249402 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77dbf0de-052e-4736-baee-0da84b4a2e39 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:40.249863 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77dbf0de-052e-4736-baee-0da84b4a2e39 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:40.250553 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77dbf0de-052e-4736-baee-0da84b4a2e39 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:40.251001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77dbf0de-052e-4736-baee-0da84b4a2e39 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:40.251423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-77dbf0de-052e-4736-baee-0da84b4a2e39 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:40.299383 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:40.299986 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:40.305754 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:40.306229 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:40.306654 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:40.307330 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:40.307793 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:40.308176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:40.332470 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-77dbf0de-052e-4736-baee-0da84b4a2e39 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lazy-loading 'services' on Instance uuid 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:40.340538 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:40.341055 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:40.341495 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:40.342097 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lazy-loading 'fault' on Instance uuid d2ad7906-3b73-4fc9-a692-9692fb6234b3 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:40.382738 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:40.391424 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2712dfca-6932-4288-bfb9-05bf766805ae tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 200 len: 1326 microversion: 2.1 time: 0.095769 Sep 08 13:58:40.391978 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 387/771] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:40 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:40.407967 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-77dbf0de-052e-4736-baee-0da84b4a2e39 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments/197857d8-858e-41ad-ac57-5add8ce1c6ef" status: 202 len: 0 microversion: 2.1 time: 0.169869 Sep 08 13:58:40.408542 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 385/772] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 13:58:40 2022] DELETE /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments/197857d8-858e-41ad-ac57-5add8ce1c6ef => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:58:40.416734 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5d18d579-a5ca-46e0-bf82-a4f4a68895ed tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:40.418893 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5d18d579-a5ca-46e0-bf82-a4f4a68895ed tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:40.425234 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d18d579-a5ca-46e0-bf82-a4f4a68895ed tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:40.425711 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d18d579-a5ca-46e0-bf82-a4f4a68895ed tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:40.426174 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d18d579-a5ca-46e0-bf82-a4f4a68895ed tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:40.426856 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d18d579-a5ca-46e0-bf82-a4f4a68895ed tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:40.427304 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d18d579-a5ca-46e0-bf82-a4f4a68895ed tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:40.427719 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5d18d579-a5ca-46e0-bf82-a4f4a68895ed tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:40.457292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5d18d579-a5ca-46e0-bf82-a4f4a68895ed tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Sep 08 13:58:40.457869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 388/773] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:40 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:41.152679 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bdf1228d-2e16-4151-bc5a-51339c87f839 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:41.155609 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bdf1228d-2e16-4151-bc5a-51339c87f839 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:41.161904 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdf1228d-2e16-4151-bc5a-51339c87f839 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:41.162388 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdf1228d-2e16-4151-bc5a-51339c87f839 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:41.162828 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdf1228d-2e16-4151-bc5a-51339c87f839 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:41.163525 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdf1228d-2e16-4151-bc5a-51339c87f839 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:41.163975 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdf1228d-2e16-4151-bc5a-51339c87f839 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:41.164396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdf1228d-2e16-4151-bc5a-51339c87f839 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:41.193553 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bdf1228d-2e16-4151-bc5a-51339c87f839 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045757 Sep 08 13:58:41.194135 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 386/774] 10.222.0.55 () {60 vars in 1343 bytes} [Thu Sep 8 13:58:41 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:58:41.415286 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:41.415927 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:41.422992 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:41.423474 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:41.423906 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:41.424591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:41.425042 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:41.425462 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:41.438594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] HTTP exception thrown: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Request method failure captured: Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 HTTP/1.1 Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOrOjix53dZZ-KOn42GSZJ-XTCZC2Jls6slzU5d4mcBdjcp9Qsfc6FIayn-sZJEKs-4VzeniA8eXaUwvw07SwpkxalJrw4rr4bZ6IedNOAYf3sG8TVUgFFRURXr28rI3b5hfkHDsgZnkp4iiVyWvFjQyaSKiCPC3kGP2BGa6Mn0WeY Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:58:41.440143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6998e0c9a62e4f54a27faf56dbeb543a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeTestJSON-1451638346 Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 96744eb6a9cf4895b6101e209d1fdd29 Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 13:58:41.441805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': 'd2ad7906-3b73-4fc9-a692-9692fb6234b3'} Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:58:41.442777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 13:58:41.444275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:41.445903 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Returning 404 to user: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:58:41.445903 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-904887fa-b4e9-4ddc-ac3f-8d347957c4cd tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 404 len: 111 microversion: 2.1 time: 0.030119 Sep 08 13:58:41.445903 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 389/775] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:41 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:41.450733 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d7c51d5-5304-4f9c-b496-1c5014780bbc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '.version_select at 0x7f5be4421820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:41.469984 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e522fd65-a1f8-42f2-9454-2752daa55e96 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:41.470202 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d7c51d5-5304-4f9c-b496-1c5014780bbc tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-940748884" status: 202 len: 0 microversion: 2.1 time: 0.023077 Sep 08 13:58:41.470615 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 387/776] 10.222.0.55 () {58 vars in 1218 bytes} [Thu Sep 8 13:58:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-940748884 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:58:41.472137 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e522fd65-a1f8-42f2-9454-2752daa55e96 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:41.478166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e522fd65-a1f8-42f2-9454-2752daa55e96 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:41.478652 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e522fd65-a1f8-42f2-9454-2752daa55e96 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:41.479085 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e522fd65-a1f8-42f2-9454-2752daa55e96 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:41.479778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e522fd65-a1f8-42f2-9454-2752daa55e96 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:41.480229 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e522fd65-a1f8-42f2-9454-2752daa55e96 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:41.480650 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e522fd65-a1f8-42f2-9454-2752daa55e96 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:41.510819 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e522fd65-a1f8-42f2-9454-2752daa55e96 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045238 Sep 08 13:58:41.512135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 390/777] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:41 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:58:42.080211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-438dde31-82f7-4f0d-8b38-7ec35dbf9b7d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:42.080704 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-438dde31-82f7-4f0d-8b38-7ec35dbf9b7d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:42.086608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-438dde31-82f7-4f0d-8b38-7ec35dbf9b7d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.087095 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-438dde31-82f7-4f0d-8b38-7ec35dbf9b7d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.087527 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-438dde31-82f7-4f0d-8b38-7ec35dbf9b7d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.088223 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-438dde31-82f7-4f0d-8b38-7ec35dbf9b7d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.088887 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-438dde31-82f7-4f0d-8b38-7ec35dbf9b7d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.089557 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-438dde31-82f7-4f0d-8b38-7ec35dbf9b7d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.112743 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a674cce7-15d9-405a-b164-e39de1f816a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Action: 'create', calling method: .version_select at 0x7f5be4356f70>, body: {"keypair": {"name": "tempest-keypair-536423575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBCd4osdn5jldzlR07m9Jo5ynXiFvNY55wJTvgEOdAcKrHrjlOZVs0VWTCgv2Pb5zbrrqZvZBMc5JHFd82yBE1oL29PiKMmcjuuSaBJQ7qCiaE/7rwF6rE/flkONav1ng=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:42.142744 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-a674cce7-15d9-405a-b164-e39de1f816a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Getting quotas for project 6998e0c9a62e4f54a27faf56dbeb543a. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:58:42.146954 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-a674cce7-15d9-405a-b164-e39de1f816a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Getting quotas for user 96744eb6a9cf4895b6101e209d1fdd29 and project 6998e0c9a62e4f54a27faf56dbeb543a. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:58:42.173180 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a674cce7-15d9-405a-b164-e39de1f816a8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064553 Sep 08 13:58:42.174401 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 391/778] 10.222.0.55 () {60 vars in 1159 bytes} [Thu Sep 8 13:58:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:42.182662 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-438dde31-82f7-4f0d-8b38-7ec35dbf9b7d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lazy-loading 'services' on Instance uuid 21bead64-8c72-4cb8-806b-f68b2fc593cc {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:42.207557 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9b8bbf75-c4d2-4e0b-bbe5-87448af1082c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:42.210182 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9b8bbf75-c4d2-4e0b-bbe5-87448af1082c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:42.216454 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b8bbf75-c4d2-4e0b-bbe5-87448af1082c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.217022 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b8bbf75-c4d2-4e0b-bbe5-87448af1082c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.217682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b8bbf75-c4d2-4e0b-bbe5-87448af1082c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.218472 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b8bbf75-c4d2-4e0b-bbe5-87448af1082c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.218991 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b8bbf75-c4d2-4e0b-bbe5-87448af1082c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.219477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9b8bbf75-c4d2-4e0b-bbe5-87448af1082c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.254397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9b8bbf75-c4d2-4e0b-bbe5-87448af1082c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052417 Sep 08 13:58:42.254960 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 392/779] 10.222.0.55 () {60 vars in 1343 bytes} [Thu Sep 8 13:58:42 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:42.268184 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-438dde31-82f7-4f0d-8b38-7ec35dbf9b7d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "DELETE /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments/161ca7c8-30ae-4481-9e2c-fdb8658f2c47" status: 202 len: 0 microversion: 2.1 time: 0.192259 Sep 08 13:58:42.269330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 388/780] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 13:58:42 2022] DELETE /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments/161ca7c8-30ae-4481-9e2c-fdb8658f2c47 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:58:42.278121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bbedfe01-abb3-4e57-a48e-55a1193d805d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:42.280313 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bbedfe01-abb3-4e57-a48e-55a1193d805d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:42.287232 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbedfe01-abb3-4e57-a48e-55a1193d805d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.288067 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbedfe01-abb3-4e57-a48e-55a1193d805d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.288698 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbedfe01-abb3-4e57-a48e-55a1193d805d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.289030 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbedfe01-abb3-4e57-a48e-55a1193d805d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.289649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbedfe01-abb3-4e57-a48e-55a1193d805d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.290087 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bbedfe01-abb3-4e57-a48e-55a1193d805d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.326594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bbedfe01-abb3-4e57-a48e-55a1193d805d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052414 Sep 08 13:58:42.327749 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 393/781] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:42 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:42.333235 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-48e68306-6cf1-426c-ad19-1fc4de83b137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:42.333235 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-48e68306-6cf1-426c-ad19-1fc4de83b137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:42.344150 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e68306-6cf1-426c-ad19-1fc4de83b137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.344694 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e68306-6cf1-426c-ad19-1fc4de83b137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.345333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e68306-6cf1-426c-ad19-1fc4de83b137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.346066 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e68306-6cf1-426c-ad19-1fc4de83b137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.346516 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e68306-6cf1-426c-ad19-1fc4de83b137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.347120 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-48e68306-6cf1-426c-ad19-1fc4de83b137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.376501 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-48e68306-6cf1-426c-ad19-1fc4de83b137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:58:42.413594 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:42.462134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-48e68306-6cf1-426c-ad19-1fc4de83b137 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "DELETE /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 204 len: 0 microversion: 2.20 time: 0.135217 Sep 08 13:58:42.462732 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 389/782] 10.222.0.55 () {60 vars in 1280 bytes} [Thu Sep 8 13:58:42 2022] DELETE /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 13:58:42.471296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:42.471977 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:42.478451 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.478927 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.479412 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.480048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.480499 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.480914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.524262 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5db7e3b6-0cc6-4965-98b9-26ff21f4b8ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:42.526561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5db7e3b6-0cc6-4965-98b9-26ff21f4b8ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:42.533252 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5db7e3b6-0cc6-4965-98b9-26ff21f4b8ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.533982 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5db7e3b6-0cc6-4965-98b9-26ff21f4b8ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.534461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5db7e3b6-0cc6-4965-98b9-26ff21f4b8ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.535182 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5db7e3b6-0cc6-4965-98b9-26ff21f4b8ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.535635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5db7e3b6-0cc6-4965-98b9-26ff21f4b8ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.536053 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5db7e3b6-0cc6-4965-98b9-26ff21f4b8ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.571636 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5db7e3b6-0cc6-4965-98b9-26ff21f4b8ba tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051793 Sep 08 13:58:42.572203 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 390/783] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:42 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 13:58:42.635486 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:42.642954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2d9c9b88-eaea-4ba7-b94e-35472dc8a82b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:42.643543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2d9c9b88-eaea-4ba7-b94e-35472dc8a82b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:42.644479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:42.646228 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:42.647482 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-69014ab2-01c2-4979-b7f9-cc29743e156f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.180184 Sep 08 13:58:42.648286 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 394/784] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:42 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:58:42.650353 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d9c9b88-eaea-4ba7-b94e-35472dc8a82b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.650894 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d9c9b88-eaea-4ba7-b94e-35472dc8a82b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.651416 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d9c9b88-eaea-4ba7-b94e-35472dc8a82b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.652168 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d9c9b88-eaea-4ba7-b94e-35472dc8a82b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.653407 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d9c9b88-eaea-4ba7-b94e-35472dc8a82b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.653407 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2d9c9b88-eaea-4ba7-b94e-35472dc8a82b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.679677 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2d9c9b88-eaea-4ba7-b94e-35472dc8a82b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:58:42.758997 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2d9c9b88-eaea-4ba7-b94e-35472dc8a82b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 204 len: 0 microversion: 2.1 time: 0.120156 Sep 08 13:58:42.760382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 391/785] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:58:42 2022] DELETE /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:58:42.767814 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-88402950-e397-4dcb-b4d6-306c8c8600e0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:42.768480 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-88402950-e397-4dcb-b4d6-306c8c8600e0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:42.774405 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88402950-e397-4dcb-b4d6-306c8c8600e0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.774888 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88402950-e397-4dcb-b4d6-306c8c8600e0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.775319 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88402950-e397-4dcb-b4d6-306c8c8600e0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.776006 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88402950-e397-4dcb-b4d6-306c8c8600e0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:42.776455 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88402950-e397-4dcb-b4d6-306c8c8600e0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:42.776879 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-88402950-e397-4dcb-b4d6-306c8c8600e0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:42.915457 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-88402950-e397-4dcb-b4d6-306c8c8600e0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:42.923672 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-88402950-e397-4dcb-b4d6-306c8c8600e0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1680 microversion: 2.1 time: 0.159734 Sep 08 13:58:42.924219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 395/786] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:42 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:43.341626 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-502af8ec-6b55-4664-8de6-73ab35450a0b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:43.343944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-502af8ec-6b55-4664-8de6-73ab35450a0b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:43.351059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-502af8ec-6b55-4664-8de6-73ab35450a0b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:43.351543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-502af8ec-6b55-4664-8de6-73ab35450a0b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:43.352105 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-502af8ec-6b55-4664-8de6-73ab35450a0b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:43.352817 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-502af8ec-6b55-4664-8de6-73ab35450a0b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:43.353272 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-502af8ec-6b55-4664-8de6-73ab35450a0b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:43.353696 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-502af8ec-6b55-4664-8de6-73ab35450a0b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:43.385951 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-502af8ec-6b55-4664-8de6-73ab35450a0b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049855 Sep 08 13:58:43.386530 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 392/787] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:43 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:43.435727 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1764792990", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96ff558b-c5db-4059-a363-a83e90cf91c8"}], "security_groups": [{"name": "tempest-securitygroup--1369176978"}], "key_name": "tempest-keypair-536423575", "user_data": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:43.538864 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] validate_networks() for [('96ff558b-c5db-4059-a363-a83e90cf91c8', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:58:43.673712 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:43.674324 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:43.680737 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:43.681454 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:43.682050 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:43.683021 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:43.683756 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:43.684404 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:43.874467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:43.882464 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:43.883896 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:43.885052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c287b25-5aa2-445c-96be-955dac35b005 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.215333 Sep 08 13:58:43.885618 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 393/788] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:43 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:58:43.947474 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7627ae2d-0574-48fe-9f97-bacc4b288637 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:43.948204 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7627ae2d-0574-48fe-9f97-bacc4b288637 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:43.954152 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7627ae2d-0574-48fe-9f97-bacc4b288637 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:43.954625 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7627ae2d-0574-48fe-9f97-bacc4b288637 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:43.955055 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7627ae2d-0574-48fe-9f97-bacc4b288637 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:43.955730 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7627ae2d-0574-48fe-9f97-bacc4b288637 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:43.956173 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7627ae2d-0574-48fe-9f97-bacc4b288637 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:43.956588 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7627ae2d-0574-48fe-9f97-bacc4b288637 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:44.028964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:58:44.029378 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:58:44.029871 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:58:44.030272 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:58:44.030675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:58:44.039219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:44.039687 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:44.040109 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:44.040815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:44.041313 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:44.041669 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:44.059564 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Getting quotas for project 6998e0c9a62e4f54a27faf56dbeb543a. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:58:44.065069 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Getting quotas for user 96744eb6a9cf4895b6101e209d1fdd29 and project 6998e0c9a62e4f54a27faf56dbeb543a. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:58:44.077634 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:58:44.080174 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:58:44.097297 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7627ae2d-0574-48fe-9f97-bacc4b288637 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:44.108382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7627ae2d-0574-48fe-9f97-bacc4b288637 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1680 microversion: 2.1 time: 0.164655 Sep 08 13:58:44.108966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 394/789] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:43 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:44.131639 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-571f5dac-b25a-4a0c-b393-9a9129e1866b tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.700661 Sep 08 13:58:44.132278 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 396/790] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:58:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:58:44.143625 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ee16e13c-78a9-4784-a260-a9b983704132 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:44.144546 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ee16e13c-78a9-4784-a260-a9b983704132 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:44.201552 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ee16e13c-78a9-4784-a260-a9b983704132 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:44.208493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ee16e13c-78a9-4784-a260-a9b983704132 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1237 microversion: 2.1 time: 0.068724 Sep 08 13:58:44.209058 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 395/791] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:44 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:44.399566 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bf47b3f0-8f2c-4d1b-818e-633311319da2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:44.402104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bf47b3f0-8f2c-4d1b-818e-633311319da2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:44.410578 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf47b3f0-8f2c-4d1b-818e-633311319da2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:44.411185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf47b3f0-8f2c-4d1b-818e-633311319da2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:44.411623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf47b3f0-8f2c-4d1b-818e-633311319da2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:44.412361 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf47b3f0-8f2c-4d1b-818e-633311319da2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:44.412990 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf47b3f0-8f2c-4d1b-818e-633311319da2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:44.413426 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf47b3f0-8f2c-4d1b-818e-633311319da2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:44.442854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bf47b3f0-8f2c-4d1b-818e-633311319da2 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047933 Sep 08 13:58:44.443420 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 397/792] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:44 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:44.910821 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:44.911198 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:44.918314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:44.918788 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:44.919918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:44.920603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:44.921048 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:44.921464 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:45.046385 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:45.054394 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:45.055820 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:45.056961 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3e95a99d-b02a-4805-a27a-519838f950f7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.150212 Sep 08 13:58:45.057513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 396/793] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:44 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:58:45.134985 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4d24f00d-741b-4a98-859f-295e24e205bb tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:45.135593 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4d24f00d-741b-4a98-859f-295e24e205bb tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:45.142448 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d24f00d-741b-4a98-859f-295e24e205bb tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:45.142928 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d24f00d-741b-4a98-859f-295e24e205bb tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:45.143361 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d24f00d-741b-4a98-859f-295e24e205bb tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:45.144042 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d24f00d-741b-4a98-859f-295e24e205bb tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:45.144508 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d24f00d-741b-4a98-859f-295e24e205bb tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:45.144924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4d24f00d-741b-4a98-859f-295e24e205bb tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:45.231561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d1a6a932-3709-438f-afa5-78e2d46c48e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:45.232185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d1a6a932-3709-438f-afa5-78e2d46c48e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:45.238073 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1a6a932-3709-438f-afa5-78e2d46c48e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:45.238558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1a6a932-3709-438f-afa5-78e2d46c48e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:45.238992 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1a6a932-3709-438f-afa5-78e2d46c48e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:45.239701 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1a6a932-3709-438f-afa5-78e2d46c48e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:45.240174 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1a6a932-3709-438f-afa5-78e2d46c48e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:45.240615 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d1a6a932-3709-438f-afa5-78e2d46c48e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:45.271068 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-4d24f00d-741b-4a98-859f-295e24e205bb tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:45.274435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:45.280083 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4d24f00d-741b-4a98-859f-295e24e205bb tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1680 microversion: 2.1 time: 0.148849 Sep 08 13:58:45.280654 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 398/794] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:45 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:45.303701 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d1a6a932-3709-438f-afa5-78e2d46c48e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:45.311370 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d1a6a932-3709-438f-afa5-78e2d46c48e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1241 microversion: 2.1 time: 0.083582 Sep 08 13:58:45.312085 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 397/795] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:45 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:45.455882 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-efc47f05-c72b-45ad-9d01-ae95162e6329 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:45.458157 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-efc47f05-c72b-45ad-9d01-ae95162e6329 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:45.464670 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc47f05-c72b-45ad-9d01-ae95162e6329 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:45.465152 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc47f05-c72b-45ad-9d01-ae95162e6329 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:45.465585 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc47f05-c72b-45ad-9d01-ae95162e6329 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:45.466307 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc47f05-c72b-45ad-9d01-ae95162e6329 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:45.466758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc47f05-c72b-45ad-9d01-ae95162e6329 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:45.467180 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-efc47f05-c72b-45ad-9d01-ae95162e6329 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:45.495549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-efc47f05-c72b-45ad-9d01-ae95162e6329 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Sep 08 13:58:45.496028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 399/796] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:45 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:46.081555 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:46.082202 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:46.090113 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:46.090609 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:46.091553 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:46.092269 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:46.092727 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:46.093148 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:46.224262 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:46.232867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:46.234335 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:46.235484 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8db82ccd-9593-49bb-93c0-bcd72539c9fa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.157906 Sep 08 13:58:46.236039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 398/797] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:46 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:58:46.302970 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-af63aae3-2f4d-4266-8fb9-f75d962b4057 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:46.303571 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-af63aae3-2f4d-4266-8fb9-f75d962b4057 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:46.309935 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af63aae3-2f4d-4266-8fb9-f75d962b4057 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:46.310405 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af63aae3-2f4d-4266-8fb9-f75d962b4057 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:46.310833 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af63aae3-2f4d-4266-8fb9-f75d962b4057 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:46.311508 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af63aae3-2f4d-4266-8fb9-f75d962b4057 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:46.311952 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af63aae3-2f4d-4266-8fb9-f75d962b4057 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:46.312364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-af63aae3-2f4d-4266-8fb9-f75d962b4057 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:46.334303 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3224c173-fd7d-476d-a21a-b27cbdf6363c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:46.334918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3224c173-fd7d-476d-a21a-b27cbdf6363c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:46.341603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3224c173-fd7d-476d-a21a-b27cbdf6363c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:46.342111 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3224c173-fd7d-476d-a21a-b27cbdf6363c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:46.342544 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3224c173-fd7d-476d-a21a-b27cbdf6363c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:46.343241 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3224c173-fd7d-476d-a21a-b27cbdf6363c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:46.343701 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3224c173-fd7d-476d-a21a-b27cbdf6363c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:46.344125 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3224c173-fd7d-476d-a21a-b27cbdf6363c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:46.414576 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3224c173-fd7d-476d-a21a-b27cbdf6363c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:46.422937 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3224c173-fd7d-476d-a21a-b27cbdf6363c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1241 microversion: 2.1 time: 0.092366 Sep 08 13:58:46.423505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 399/798] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:46 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:46.473390 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-af63aae3-2f4d-4266-8fb9-f75d962b4057 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:46.481390 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-af63aae3-2f4d-4266-8fb9-f75d962b4057 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1680 microversion: 2.1 time: 0.182223 Sep 08 13:58:46.481994 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 400/799] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:46 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:46.508327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fa831929-5fde-4ea0-b35e-ec96b063216b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:46.510629 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fa831929-5fde-4ea0-b35e-ec96b063216b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:46.516998 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa831929-5fde-4ea0-b35e-ec96b063216b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:46.517474 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa831929-5fde-4ea0-b35e-ec96b063216b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:46.517965 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa831929-5fde-4ea0-b35e-ec96b063216b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:46.518655 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa831929-5fde-4ea0-b35e-ec96b063216b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:46.519107 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa831929-5fde-4ea0-b35e-ec96b063216b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:46.519527 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fa831929-5fde-4ea0-b35e-ec96b063216b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:46.549045 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fa831929-5fde-4ea0-b35e-ec96b063216b tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044711 Sep 08 13:58:46.549614 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 400/800] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:46 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:47.260653 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:47.261174 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:47.267593 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:47.268072 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:47.268503 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:47.269187 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:47.269637 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:47.270083 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:47.445766 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06518a20-e03a-4b2b-ac1e-97a5f1d3f371 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:47.446610 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06518a20-e03a-4b2b-ac1e-97a5f1d3f371 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:47.454627 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06518a20-e03a-4b2b-ac1e-97a5f1d3f371 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:47.455120 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06518a20-e03a-4b2b-ac1e-97a5f1d3f371 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:47.455559 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06518a20-e03a-4b2b-ac1e-97a5f1d3f371 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:47.456742 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06518a20-e03a-4b2b-ac1e-97a5f1d3f371 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:47.456917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06518a20-e03a-4b2b-ac1e-97a5f1d3f371 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:47.457286 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06518a20-e03a-4b2b-ac1e-97a5f1d3f371 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:47.457642 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:47.469575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:47.472463 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:47.474172 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-81871a2d-3edc-4213-a676-2a518d1e9d00 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.217322 Sep 08 13:58:47.475354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 401/801] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:47 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:58:47.503619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d6a7a07b-c4d8-4346-9309-21d41f9360b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:47.504389 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d6a7a07b-c4d8-4346-9309-21d41f9360b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:47.510738 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6a7a07b-c4d8-4346-9309-21d41f9360b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:47.511145 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6a7a07b-c4d8-4346-9309-21d41f9360b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:47.511567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6a7a07b-c4d8-4346-9309-21d41f9360b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:47.512261 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6a7a07b-c4d8-4346-9309-21d41f9360b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:47.513216 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6a7a07b-c4d8-4346-9309-21d41f9360b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:47.513638 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d6a7a07b-c4d8-4346-9309-21d41f9360b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:47.602577 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-06518a20-e03a-4b2b-ac1e-97a5f1d3f371 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:47.610936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06518a20-e03a-4b2b-ac1e-97a5f1d3f371 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1233 microversion: 2.1 time: 0.169091 Sep 08 13:58:47.611507 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 401/802] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:47 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1233 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:47.621991 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b468259d-3dbc-485f-9c3f-2a628262f433 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:47.621991 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b468259d-3dbc-485f-9c3f-2a628262f433 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:47.625217 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b468259d-3dbc-485f-9c3f-2a628262f433 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:47.625699 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b468259d-3dbc-485f-9c3f-2a628262f433 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:47.626224 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b468259d-3dbc-485f-9c3f-2a628262f433 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:47.628145 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b468259d-3dbc-485f-9c3f-2a628262f433 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:47.628622 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b468259d-3dbc-485f-9c3f-2a628262f433 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:47.629620 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b468259d-3dbc-485f-9c3f-2a628262f433 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:47.668887 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b468259d-3dbc-485f-9c3f-2a628262f433 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056240 Sep 08 13:58:47.673713 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 402/803] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:47 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:48.189638 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d6a7a07b-c4d8-4346-9309-21d41f9360b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:48.197553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d6a7a07b-c4d8-4346-9309-21d41f9360b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1680 microversion: 2.1 time: 0.697786 Sep 08 13:58:48.198235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 402/804] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:47 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1680 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:48.501409 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:48.502032 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:48.509093 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:48.509691 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:48.510290 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:48.511013 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:48.511823 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:48.512007 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:48.637303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-713d9530-8b9c-424f-9006-c1748b6631a7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:48.638579 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-713d9530-8b9c-424f-9006-c1748b6631a7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:48.647324 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713d9530-8b9c-424f-9006-c1748b6631a7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:48.648655 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713d9530-8b9c-424f-9006-c1748b6631a7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:48.649671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713d9530-8b9c-424f-9006-c1748b6631a7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:48.651042 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713d9530-8b9c-424f-9006-c1748b6631a7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:48.652400 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713d9530-8b9c-424f-9006-c1748b6631a7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:48.653182 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-713d9530-8b9c-424f-9006-c1748b6631a7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:48.761598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-713d9530-8b9c-424f-9006-c1748b6631a7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:48.771828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-713d9530-8b9c-424f-9006-c1748b6631a7 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1307 microversion: 2.1 time: 0.139502 Sep 08 13:58:48.786774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 403/805] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:48 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1307 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:48.786774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8311457b-c57c-4c12-aded-573db13093d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:48.787228 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8311457b-c57c-4c12-aded-573db13093d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:48.796619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8311457b-c57c-4c12-aded-573db13093d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:48.797111 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8311457b-c57c-4c12-aded-573db13093d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:48.797940 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8311457b-c57c-4c12-aded-573db13093d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:48.798849 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8311457b-c57c-4c12-aded-573db13093d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:48.799306 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8311457b-c57c-4c12-aded-573db13093d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:48.799729 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8311457b-c57c-4c12-aded-573db13093d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:48.835443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8311457b-c57c-4c12-aded-573db13093d9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055777 Sep 08 13:58:48.836044 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 404/806] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:48 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:58:48.865611 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:48.875949 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:48.877415 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:48.878774 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8af0674e-8af5-4992-948e-0983bf16c0f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1722 microversion: 2.20 time: 0.381958 Sep 08 13:58:48.879512 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 403/807] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:48 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:58:48.923529 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d1f3444b-4c90-4bfc-bf0d-1e546fb7529a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:48.924281 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1f3444b-4c90-4bfc-bf0d-1e546fb7529a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:48.930567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1f3444b-4c90-4bfc-bf0d-1e546fb7529a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:48.931329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1f3444b-4c90-4bfc-bf0d-1e546fb7529a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:48.931925 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1f3444b-4c90-4bfc-bf0d-1e546fb7529a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:48.932697 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1f3444b-4c90-4bfc-bf0d-1e546fb7529a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:48.933225 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1f3444b-4c90-4bfc-bf0d-1e546fb7529a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:48.933769 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1f3444b-4c90-4bfc-bf0d-1e546fb7529a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:48.973193 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1f3444b-4c90-4bfc-bf0d-1e546fb7529a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:58:49.057951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d1f3444b-4c90-4bfc-bf0d-1e546fb7529a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "DELETE /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 204 len: 0 microversion: 2.1 time: 0.139196 Sep 08 13:58:49.058660 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 405/808] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:58:48 2022] DELETE /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:58:49.067838 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bdc9bb5c-ad7b-40fe-a791-f7cccd74cfa6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:49.068449 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bdc9bb5c-ad7b-40fe-a791-f7cccd74cfa6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:49.076654 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdc9bb5c-ad7b-40fe-a791-f7cccd74cfa6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.077141 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdc9bb5c-ad7b-40fe-a791-f7cccd74cfa6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.077577 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdc9bb5c-ad7b-40fe-a791-f7cccd74cfa6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.078313 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdc9bb5c-ad7b-40fe-a791-f7cccd74cfa6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.078771 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdc9bb5c-ad7b-40fe-a791-f7cccd74cfa6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.079193 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bdc9bb5c-ad7b-40fe-a791-f7cccd74cfa6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.221276 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86a22dca-2703-497f-9902-232355941924 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:49.222132 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86a22dca-2703-497f-9902-232355941924 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:49.228443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a22dca-2703-497f-9902-232355941924 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.228931 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a22dca-2703-497f-9902-232355941924 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.229363 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a22dca-2703-497f-9902-232355941924 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.231689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a22dca-2703-497f-9902-232355941924 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.231689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a22dca-2703-497f-9902-232355941924 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.232002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a22dca-2703-497f-9902-232355941924 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.382662 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-bdc9bb5c-ad7b-40fe-a791-f7cccd74cfa6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:49.393592 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-86a22dca-2703-497f-9902-232355941924 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:49.400771 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bdc9bb5c-ad7b-40fe-a791-f7cccd74cfa6 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1689 microversion: 2.1 time: 0.337600 Sep 08 13:58:49.401373 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 404/809] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:49 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1689 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:49.408544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86a22dca-2703-497f-9902-232355941924 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1613 microversion: 2.1 time: 0.191405 Sep 08 13:58:49.421822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 406/810] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:49 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1613 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:49.599013 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-26bf0093-e53b-4aac-b8fc-de58d287dd6c req-65ec8d88-2fa4-4230-82a2-83d5162889e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b6fbb8-a2c9-4c92-b120-8ea3259c9b56", "name": "network-vif-deleted", "tag": "c57d5f48-246f-41c1-903a-f9a3fa47d52b"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:49.612063 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-26bf0093-e53b-4aac-b8fc-de58d287dd6c req-65ec8d88-2fa4-4230-82a2-83d5162889e5 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.620320 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-26bf0093-e53b-4aac-b8fc-de58d287dd6c req-65ec8d88-2fa4-4230-82a2-83d5162889e5 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.621206 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-26bf0093-e53b-4aac-b8fc-de58d287dd6c req-65ec8d88-2fa4-4230-82a2-83d5162889e5 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.642016 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:49.644672 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-26bf0093-e53b-4aac-b8fc-de58d287dd6c req-65ec8d88-2fa4-4230-82a2-83d5162889e5 service nova] Creating event network-vif-deleted:c57d5f48-246f-41c1-903a-f9a3fa47d52b for instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 on hv-cinder-82002 Sep 08 13:58:49.651298 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-26bf0093-e53b-4aac-b8fc-de58d287dd6c req-65ec8d88-2fa4-4230-82a2-83d5162889e5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058740 Sep 08 13:58:49.652629 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 405/811] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:58:49.798777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a2347000-5c5d-4247-9b30-6d86c554f55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:49.799239 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a2347000-5c5d-4247-9b30-6d86c554f55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:49.805462 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2347000-5c5d-4247-9b30-6d86c554f55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.806236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2347000-5c5d-4247-9b30-6d86c554f55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.806827 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2347000-5c5d-4247-9b30-6d86c554f55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.807733 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2347000-5c5d-4247-9b30-6d86c554f55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.808183 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2347000-5c5d-4247-9b30-6d86c554f55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.808787 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a2347000-5c5d-4247-9b30-6d86c554f55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.919547 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:49.920461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:49.938902 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.939680 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.939923 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.940665 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.941115 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.941541 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.975210 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a2347000-5c5d-4247-9b30-6d86c554f55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:49.991592 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a2347000-5c5d-4247-9b30-6d86c554f55a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1363 microversion: 2.1 time: 0.197419 Sep 08 13:58:50.003019 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 407/812] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:49 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:50.036830 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:50.047163 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:50.048613 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:50.049810 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ee6a3402-c492-486a-b586-f4ed5451ea5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1654 microversion: 2.20 time: 0.135701 Sep 08 13:58:50.050369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 406/813] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:49 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1654 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:58:50.425213 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-17da07e2-b762-4e4b-b288-fb95d1410f6a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:50.427452 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-17da07e2-b762-4e4b-b288-fb95d1410f6a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:50.432058 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17da07e2-b762-4e4b-b288-fb95d1410f6a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:50.432495 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-60d58636-7687-46de-845f-5ca2bc20c750 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:50.432616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17da07e2-b762-4e4b-b288-fb95d1410f6a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:50.432953 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17da07e2-b762-4e4b-b288-fb95d1410f6a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:50.433107 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-60d58636-7687-46de-845f-5ca2bc20c750 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:50.433662 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17da07e2-b762-4e4b-b288-fb95d1410f6a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:50.434141 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17da07e2-b762-4e4b-b288-fb95d1410f6a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:50.435279 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-17da07e2-b762-4e4b-b288-fb95d1410f6a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:50.439850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d58636-7687-46de-845f-5ca2bc20c750 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:50.440522 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d58636-7687-46de-845f-5ca2bc20c750 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:50.440956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d58636-7687-46de-845f-5ca2bc20c750 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:50.441654 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d58636-7687-46de-845f-5ca2bc20c750 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:50.442129 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d58636-7687-46de-845f-5ca2bc20c750 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:50.442549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-60d58636-7687-46de-845f-5ca2bc20c750 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:50.538096 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-60d58636-7687-46de-845f-5ca2bc20c750 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:50.547322 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-60d58636-7687-46de-845f-5ca2bc20c750 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1613 microversion: 2.1 time: 0.118429 Sep 08 13:58:50.548129 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 407/814] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:50 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1613 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:50.612509 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-17da07e2-b762-4e4b-b288-fb95d1410f6a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:50.620802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-17da07e2-b762-4e4b-b288-fb95d1410f6a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1689 microversion: 2.1 time: 0.199467 Sep 08 13:58:50.621587 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 408/815] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:50 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:51.016446 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1bb95a45-01de-4036-84c0-a71041dd2512 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:51.017057 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1bb95a45-01de-4036-84c0-a71041dd2512 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:51.023383 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bb95a45-01de-4036-84c0-a71041dd2512 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:51.023860 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bb95a45-01de-4036-84c0-a71041dd2512 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:51.024294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bb95a45-01de-4036-84c0-a71041dd2512 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:51.024977 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bb95a45-01de-4036-84c0-a71041dd2512 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:51.025426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bb95a45-01de-4036-84c0-a71041dd2512 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:51.025879 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1bb95a45-01de-4036-84c0-a71041dd2512 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:51.075935 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:51.076641 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:51.083071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:51.083555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:51.083984 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:51.084671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:51.085119 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:51.085544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:51.166573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:51.174569 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:51.176000 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:51.177196 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac2e62aa-071d-41fe-95d7-fa57aaf9a2ae tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1654 microversion: 2.20 time: 0.105740 Sep 08 13:58:51.177774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 409/816] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:51 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1654 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:58:51.182553 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1bb95a45-01de-4036-84c0-a71041dd2512 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:51.190066 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1bb95a45-01de-4036-84c0-a71041dd2512 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1363 microversion: 2.1 time: 0.178006 Sep 08 13:58:51.190629 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 408/817] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:51 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:51.571254 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86a5b062-1c74-45e2-ad5f-d9afc4efafc3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:51.571865 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86a5b062-1c74-45e2-ad5f-d9afc4efafc3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:51.578399 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a5b062-1c74-45e2-ad5f-d9afc4efafc3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:51.578874 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a5b062-1c74-45e2-ad5f-d9afc4efafc3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:51.579302 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a5b062-1c74-45e2-ad5f-d9afc4efafc3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:51.579990 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a5b062-1c74-45e2-ad5f-d9afc4efafc3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:51.580439 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a5b062-1c74-45e2-ad5f-d9afc4efafc3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:51.580856 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86a5b062-1c74-45e2-ad5f-d9afc4efafc3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:51.641176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-86a5b062-1c74-45e2-ad5f-d9afc4efafc3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:51.649138 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86a5b062-1c74-45e2-ad5f-d9afc4efafc3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1613 microversion: 2.1 time: 0.081689 Sep 08 13:58:51.649368 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ee04a0d-7280-4199-bda6-179f1d7e49eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:51.649706 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 410/818] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:51 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1613 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:51.650001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ee04a0d-7280-4199-bda6-179f1d7e49eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:51.655937 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee04a0d-7280-4199-bda6-179f1d7e49eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:51.656417 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee04a0d-7280-4199-bda6-179f1d7e49eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:51.656850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee04a0d-7280-4199-bda6-179f1d7e49eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:51.657555 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee04a0d-7280-4199-bda6-179f1d7e49eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:51.658058 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee04a0d-7280-4199-bda6-179f1d7e49eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:51.658482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee04a0d-7280-4199-bda6-179f1d7e49eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:51.667020 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-b01f8b10-d823-4f8b-97e7-ced69ad4b0b4 req-eaa02b8b-315b-4a0d-9fc4-5e9eb4997f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdb4c65-ed8d-4792-ac96-8b1053b167b5", "name": "network-vif-deleted", "tag": "c9da782b-975b-4d78-bc93-092cf58fcf3a"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:51.676440 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b01f8b10-d823-4f8b-97e7-ced69ad4b0b4 req-eaa02b8b-315b-4a0d-9fc4-5e9eb4997f77 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:51.676914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b01f8b10-d823-4f8b-97e7-ced69ad4b0b4 req-eaa02b8b-315b-4a0d-9fc4-5e9eb4997f77 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:51.677345 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-b01f8b10-d823-4f8b-97e7-ced69ad4b0b4 req-eaa02b8b-315b-4a0d-9fc4-5e9eb4997f77 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:51.689266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-b01f8b10-d823-4f8b-97e7-ced69ad4b0b4 req-eaa02b8b-315b-4a0d-9fc4-5e9eb4997f77 service nova] Creating event network-vif-deleted:c9da782b-975b-4d78-bc93-092cf58fcf3a for instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 on hv-cinder-82002 Sep 08 13:58:51.694169 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-b01f8b10-d823-4f8b-97e7-ced69ad4b0b4 req-eaa02b8b-315b-4a0d-9fc4-5e9eb4997f77 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030988 Sep 08 13:58:51.694755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 411/819] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:58:51.795945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ee04a0d-7280-4199-bda6-179f1d7e49eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:51.803426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ee04a0d-7280-4199-bda6-179f1d7e49eb tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1689 microversion: 2.1 time: 0.157870 Sep 08 13:58:51.803994 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 409/820] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:51 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:52.203749 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:52.204365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:52.207335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:52.211523 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.212003 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.212447 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:52.212561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9c54169d-1c04-4373-bacf-20f631d0cbf3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:52.213139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.213244 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9c54169d-1c04-4373-bacf-20f631d0cbf3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:52.213592 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.214039 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:52.220432 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c54169d-1c04-4373-bacf-20f631d0cbf3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.220996 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c54169d-1c04-4373-bacf-20f631d0cbf3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.221516 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c54169d-1c04-4373-bacf-20f631d0cbf3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:52.222240 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c54169d-1c04-4373-bacf-20f631d0cbf3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.222700 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c54169d-1c04-4373-bacf-20f631d0cbf3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.223122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9c54169d-1c04-4373-bacf-20f631d0cbf3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:52.299811 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:52.307821 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:52.309296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:52.310481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-46f5bffc-b467-4ba9-a8d8-2622899f64ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1654 microversion: 2.20 time: 0.111693 Sep 08 13:58:52.311045 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 412/821] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:52 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1654 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:58:52.366035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9c54169d-1c04-4373-bacf-20f631d0cbf3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:52.373452 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9c54169d-1c04-4373-bacf-20f631d0cbf3 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1363 microversion: 2.1 time: 0.164926 Sep 08 13:58:52.374045 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 410/822] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:52 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:52.673359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6052d2dc-7c22-4745-a983-c797d7b036dc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:52.673988 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6052d2dc-7c22-4745-a983-c797d7b036dc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:52.679907 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6052d2dc-7c22-4745-a983-c797d7b036dc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.680383 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6052d2dc-7c22-4745-a983-c797d7b036dc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.680808 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6052d2dc-7c22-4745-a983-c797d7b036dc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:52.681485 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6052d2dc-7c22-4745-a983-c797d7b036dc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.681951 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6052d2dc-7c22-4745-a983-c797d7b036dc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.682363 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6052d2dc-7c22-4745-a983-c797d7b036dc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:52.745581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6052d2dc-7c22-4745-a983-c797d7b036dc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:52.753255 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6052d2dc-7c22-4745-a983-c797d7b036dc tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1613 microversion: 2.1 time: 0.083772 Sep 08 13:58:52.753842 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 413/823] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:52 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:52.827312 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a9222b70-74c3-4cf4-af08-e43d62ad4b49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:52.827920 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a9222b70-74c3-4cf4-af08-e43d62ad4b49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:52.834165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9222b70-74c3-4cf4-af08-e43d62ad4b49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.834697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9222b70-74c3-4cf4-af08-e43d62ad4b49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.835174 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9222b70-74c3-4cf4-af08-e43d62ad4b49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:52.835903 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9222b70-74c3-4cf4-af08-e43d62ad4b49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.836422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9222b70-74c3-4cf4-af08-e43d62ad4b49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.836837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9222b70-74c3-4cf4-af08-e43d62ad4b49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:52.965145 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a9222b70-74c3-4cf4-af08-e43d62ad4b49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:52.972736 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a9222b70-74c3-4cf4-af08-e43d62ad4b49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1689 microversion: 2.1 time: 0.149795 Sep 08 13:58:52.973302 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 411/824] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:52 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:53.335975 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:53.336521 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:53.343746 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:53.344227 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:53.344663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:53.345351 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:53.345827 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:53.346250 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:53.364038 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:53.395967 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ecb67cb-a09a-4c54-be09-0b41e7562a47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:53.396577 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ecb67cb-a09a-4c54-be09-0b41e7562a47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:53.402884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecb67cb-a09a-4c54-be09-0b41e7562a47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:53.403411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecb67cb-a09a-4c54-be09-0b41e7562a47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:53.404379 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecb67cb-a09a-4c54-be09-0b41e7562a47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:53.405067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecb67cb-a09a-4c54-be09-0b41e7562a47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:53.405512 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecb67cb-a09a-4c54-be09-0b41e7562a47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:53.405964 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ecb67cb-a09a-4c54-be09-0b41e7562a47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:53.409479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:53.417772 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:53.419248 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:53.420415 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5ba667e3-090a-495e-a807-df91ca1db370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1654 microversion: 2.20 time: 0.088444 Sep 08 13:58:53.421171 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 414/825] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:53 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1654 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:58:53.553212 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1ecb67cb-a09a-4c54-be09-0b41e7562a47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:53.562297 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ecb67cb-a09a-4c54-be09-0b41e7562a47 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1363 microversion: 2.1 time: 0.169994 Sep 08 13:58:53.562619 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 412/826] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:53 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:53.776296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c8566b4b-72f8-4e81-bc06-57cb580e6e98 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:53.776906 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c8566b4b-72f8-4e81-bc06-57cb580e6e98 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:53.782895 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8566b4b-72f8-4e81-bc06-57cb580e6e98 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:53.783376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8566b4b-72f8-4e81-bc06-57cb580e6e98 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:53.783804 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8566b4b-72f8-4e81-bc06-57cb580e6e98 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:53.784494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8566b4b-72f8-4e81-bc06-57cb580e6e98 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:53.784939 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8566b4b-72f8-4e81-bc06-57cb580e6e98 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:53.785355 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c8566b4b-72f8-4e81-bc06-57cb580e6e98 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:53.849772 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c8566b4b-72f8-4e81-bc06-57cb580e6e98 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:53.857931 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c8566b4b-72f8-4e81-bc06-57cb580e6e98 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1325 microversion: 2.1 time: 0.085321 Sep 08 13:58:53.858838 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 415/827] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:53 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1325 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:53.996156 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-96d43418-ded6-4685-9c36-6ada1f25d379 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:53.996909 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-96d43418-ded6-4685-9c36-6ada1f25d379 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:54.003517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96d43418-ded6-4685-9c36-6ada1f25d379 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.004002 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96d43418-ded6-4685-9c36-6ada1f25d379 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.004438 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96d43418-ded6-4685-9c36-6ada1f25d379 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.005137 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96d43418-ded6-4685-9c36-6ada1f25d379 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.005585 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96d43418-ded6-4685-9c36-6ada1f25d379 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.006062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-96d43418-ded6-4685-9c36-6ada1f25d379 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.208516 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:54.242784 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-96d43418-ded6-4685-9c36-6ada1f25d379 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:54.258426 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-74d5b681-45f6-4ccf-adc3-32b255dab427 req-4aa1eb3d-29af-4c3e-90c0-144161672eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e839a72-e12e-4617-88c9-ed12f748c399", "tag": "1e7eb6da-3323-4042-81a8-99078c8d7b4e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:54.265006 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-96d43418-ded6-4685-9c36-6ada1f25d379 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1689 microversion: 2.1 time: 0.272543 Sep 08 13:58:54.267421 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:54.270355 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:54.278908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-74d5b681-45f6-4ccf-adc3-32b255dab427 req-4aa1eb3d-29af-4c3e-90c0-144161672eea service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.279099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-74d5b681-45f6-4ccf-adc3-32b255dab427 req-4aa1eb3d-29af-4c3e-90c0-144161672eea service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.279388 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-74d5b681-45f6-4ccf-adc3-32b255dab427 req-4aa1eb3d-29af-4c3e-90c0-144161672eea service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.289854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 413/828] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:53 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1689 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:54.297296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-74d5b681-45f6-4ccf-adc3-32b255dab427 req-4aa1eb3d-29af-4c3e-90c0-144161672eea service nova] Creating event network-changed:1e7eb6da-3323-4042-81a8-99078c8d7b4e for instance 9e839a72-e12e-4617-88c9-ed12f748c399 on hv-cinder-82002 Sep 08 13:58:54.302507 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-74d5b681-45f6-4ccf-adc3-32b255dab427 req-4aa1eb3d-29af-4c3e-90c0-144161672eea service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048464 Sep 08 13:58:54.303175 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 416/829] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:58:54.445896 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:54.446649 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:54.453317 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.453935 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.454375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.455076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.455532 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.456072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.485243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:54.488918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.489423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.489879 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.490323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lazy-loading 'fault' on Instance uuid efdb4c65-ed8d-4792-ac96-8b1053b167b5 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:54.564804 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:54.573001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:54.574475 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:54.575656 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-89130117-b123-4590-ae22-c5cfb08e3034 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1370 microversion: 2.20 time: 0.133766 Sep 08 13:58:54.576410 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 414/830] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:54 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1370 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:58:54.594451 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee9d05dd-8dde-43fe-9c4b-0958f5893fdf tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:54.595236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee9d05dd-8dde-43fe-9c4b-0958f5893fdf tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:54.601580 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9d05dd-8dde-43fe-9c4b-0958f5893fdf tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.602098 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9d05dd-8dde-43fe-9c4b-0958f5893fdf tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.602534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9d05dd-8dde-43fe-9c4b-0958f5893fdf tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.603218 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9d05dd-8dde-43fe-9c4b-0958f5893fdf tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.603673 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9d05dd-8dde-43fe-9c4b-0958f5893fdf tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.604179 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee9d05dd-8dde-43fe-9c4b-0958f5893fdf tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.881537 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:54.882187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:54.891323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.891850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.892291 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.893181 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.893909 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.894385 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.941878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.942393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.942836 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.943286 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lazy-loading 'fault' on Instance uuid 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:55.090404 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:55.099594 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f9a0b315-4063-4161-a8b9-326ca6c697b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1330 microversion: 2.1 time: 0.221844 Sep 08 13:58:55.100498 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 415/831] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:54 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1330 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:55.117668 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ee9d05dd-8dde-43fe-9c4b-0958f5893fdf tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:55.127204 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee9d05dd-8dde-43fe-9c4b-0958f5893fdf tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1363 microversion: 2.1 time: 0.537952 Sep 08 13:58:55.127578 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 417/832] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:54 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1363 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:55.292474 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ddbdada7-14e5-4602-ab7b-f59c39ef5260 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:55.293080 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ddbdada7-14e5-4602-ab7b-f59c39ef5260 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:55.298946 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddbdada7-14e5-4602-ab7b-f59c39ef5260 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:55.299431 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddbdada7-14e5-4602-ab7b-f59c39ef5260 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:55.299868 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddbdada7-14e5-4602-ab7b-f59c39ef5260 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:55.300567 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddbdada7-14e5-4602-ab7b-f59c39ef5260 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:55.301021 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddbdada7-14e5-4602-ab7b-f59c39ef5260 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:55.301447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ddbdada7-14e5-4602-ab7b-f59c39ef5260 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:55.374444 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ddbdada7-14e5-4602-ab7b-f59c39ef5260 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:55.389042 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ddbdada7-14e5-4602-ab7b-f59c39ef5260 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1621 microversion: 2.1 time: 0.100324 Sep 08 13:58:55.401850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 416/833] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:55 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1621 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:55.447632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-205617d5-b9a2-428a-ae60-334d7fad663f req-336541c0-c246-4ea1-8806-5dde078b481c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bead64-8c72-4cb8-806b-f68b2fc593cc", "name": "network-vif-deleted", "tag": "97326033-4991-4b35-9df8-8c1194e9ebe7"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:55.458379 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-205617d5-b9a2-428a-ae60-334d7fad663f req-336541c0-c246-4ea1-8806-5dde078b481c service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:55.458863 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-205617d5-b9a2-428a-ae60-334d7fad663f req-336541c0-c246-4ea1-8806-5dde078b481c service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:55.459584 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-205617d5-b9a2-428a-ae60-334d7fad663f req-336541c0-c246-4ea1-8806-5dde078b481c service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:55.472047 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-205617d5-b9a2-428a-ae60-334d7fad663f req-336541c0-c246-4ea1-8806-5dde078b481c service nova] Creating event network-vif-deleted:97326033-4991-4b35-9df8-8c1194e9ebe7 for instance 21bead64-8c72-4cb8-806b-f68b2fc593cc on hv-cinder-82002 Sep 08 13:58:55.478186 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-205617d5-b9a2-428a-ae60-334d7fad663f req-336541c0-c246-4ea1-8806-5dde078b481c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033982 Sep 08 13:58:55.479109 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 418/834] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:55.603517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:55.604403 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:55.612798 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:55.613295 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:55.613773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:55.614499 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:55.614952 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:55.615410 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:55.651012 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:55.651496 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:55.651933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:55.652378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lazy-loading 'fault' on Instance uuid efdb4c65-ed8d-4792-ac96-8b1053b167b5 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:55.699038 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:55.707152 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:55.708647 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:55.709847 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f454843b-bbfb-4bbf-9dcf-d2d0b1d15f86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 200 len: 1370 microversion: 2.20 time: 0.111047 Sep 08 13:58:55.710731 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 417/835] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:55 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 1370 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:58:56.126126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:56.126829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:56.133028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:56.133512 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:56.133988 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:56.134678 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:56.135131 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:56.135553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:56.150072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c1646f2-320e-47a1-af55-4733351cf923 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:56.150682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c1646f2-320e-47a1-af55-4733351cf923 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:56.157270 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c1646f2-320e-47a1-af55-4733351cf923 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:56.157921 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c1646f2-320e-47a1-af55-4733351cf923 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:56.158365 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c1646f2-320e-47a1-af55-4733351cf923 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:56.159091 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c1646f2-320e-47a1-af55-4733351cf923 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:56.159570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c1646f2-320e-47a1-af55-4733351cf923 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:56.159991 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c1646f2-320e-47a1-af55-4733351cf923 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:56.167166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:56.167649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:56.168084 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:56.168596 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lazy-loading 'fault' on Instance uuid 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:56.214740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:56.224014 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-758f2fe1-3063-4812-9fa1-551b0c2171da tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 200 len: 1330 microversion: 2.1 time: 0.103147 Sep 08 13:58:56.224014 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 419/836] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:56 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:56.315859 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c1646f2-320e-47a1-af55-4733351cf923 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:56.323694 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c1646f2-320e-47a1-af55-4733351cf923 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1363 microversion: 2.1 time: 0.177481 Sep 08 13:58:56.324280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 418/837] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:56 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:56.419283 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fff1f5a0-28f1-4712-824a-cb2b9c3f1d3c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:56.421096 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fff1f5a0-28f1-4712-824a-cb2b9c3f1d3c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:56.428820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fff1f5a0-28f1-4712-824a-cb2b9c3f1d3c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:56.429526 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fff1f5a0-28f1-4712-824a-cb2b9c3f1d3c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:56.429989 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fff1f5a0-28f1-4712-824a-cb2b9c3f1d3c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:56.430689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fff1f5a0-28f1-4712-824a-cb2b9c3f1d3c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:56.431140 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fff1f5a0-28f1-4712-824a-cb2b9c3f1d3c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:56.431564 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fff1f5a0-28f1-4712-824a-cb2b9c3f1d3c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:56.529235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-fff1f5a0-28f1-4712-824a-cb2b9c3f1d3c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:56.537144 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fff1f5a0-28f1-4712-824a-cb2b9c3f1d3c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1621 microversion: 2.1 time: 0.123569 Sep 08 13:58:56.537746 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 420/838] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:56 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1621 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:56.735396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:56.736003 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:56.742683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:56.743164 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:56.743595 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:56.744277 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:56.744727 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:56.745151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:56.758197 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] HTTP exception thrown: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Request method failure captured: Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 HTTP/1.1 Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfQFq92kMrVdozthbOpEzsVUQ43Buu-GQ_wTr90qCRDohg2vORztK0wwVACNzVXag0PWbJnt4G_rvrQGd2XexDY6I4EyntzorjlzdlqX2dKQdVHXtRXnYN44qlWJt80te1GvIdIgXbsW_FJkgITDjO3kPYbzdg5K3yw0A9SjswplHR4 Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:58:56.759813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bc4476b1f4b84b5593ff2650592b9fb7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 75642df28f5d4301b979f39482a9a11d Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 13:58:56.761513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': 'efdb4c65-ed8d-4792-ac96-8b1053b167b5'} Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:58:56.762482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 13:58:56.764043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:58:56.765425 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Returning 404 to user: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:58:56.765425 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-22b17a84-b569-464a-b9fc-32edb2e90390 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 404 len: 111 microversion: 2.20 time: 0.030307 Sep 08 13:58:56.765425 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 419/839] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:58:56 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:58:56.770398 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-04837a5e-1267-4388-8b97-e28a158ee43d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '.version_select at 0x7f5be4207280>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:56.789211 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-04837a5e-1267-4388-8b97-e28a158ee43d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749651817" status: 204 len: 0 microversion: 2.20 time: 0.022562 Sep 08 13:58:56.789786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 421/840] 10.222.0.55 () {60 vars in 1259 bytes} [Thu Sep 8 13:58:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749651817 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 13:58:57.249947 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:57.250722 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:57.267246 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:57.267908 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:57.268442 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:57.269862 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:57.270574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:57.271212 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:57.286492 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 HTTP/1.1 Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:58:57.288213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 13:58:57.289687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '30b6fbb8-a2c9-4c92-b120-8ea3259c9b56'} Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:58:57.290608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 13:58:57.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:58:57.293327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:58:57.293327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d262bf32-3d6c-48e4-ae5d-77ba32a4b0b3 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 404 len: 111 microversion: 2.1 time: 0.048534 Sep 08 13:58:57.293832 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 420/841] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:57 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:57.303471 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bbf23d5a-1005-42af-8c1e-981c55e73fa7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '.version_select at 0x7f5be446adc0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:57.327647 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bbf23d5a-1005-42af-8c1e-981c55e73fa7 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-259129649" status: 202 len: 0 microversion: 2.1 time: 0.029208 Sep 08 13:58:57.328882 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 422/842] 10.222.0.55 () {58 vars in 1218 bytes} [Thu Sep 8 13:58:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-259129649 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:58:57.348789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ba39b01-62b8-4ec4-83ae-f84649c779a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:57.350323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3ba39b01-62b8-4ec4-83ae-f84649c779a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:57.359021 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba39b01-62b8-4ec4-83ae-f84649c779a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:57.360174 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba39b01-62b8-4ec4-83ae-f84649c779a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:57.360928 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba39b01-62b8-4ec4-83ae-f84649c779a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:57.362565 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba39b01-62b8-4ec4-83ae-f84649c779a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:57.363325 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba39b01-62b8-4ec4-83ae-f84649c779a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:57.363974 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ba39b01-62b8-4ec4-83ae-f84649c779a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:57.562941 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:57.563834 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:57.570292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:57.570982 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:57.571585 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:57.572449 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:57.573049 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:57.573620 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:57.610840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:57.611578 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:57.612172 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:57.612605 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lazy-loading 'fault' on Instance uuid 21bead64-8c72-4cb8-806b-f68b2fc593cc {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:57.736851 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:57.748593 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ed8cb6ba-9d33-4d19-b6e6-2454fcb2d8d5 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 200 len: 1334 microversion: 2.1 time: 0.189879 Sep 08 13:58:57.750175 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 423/843] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:57 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 1334 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:57.763926 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ba39b01-62b8-4ec4-83ae-f84649c779a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:57.773079 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ba39b01-62b8-4ec4-83ae-f84649c779a9 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1363 microversion: 2.1 time: 0.428420 Sep 08 13:58:57.774592 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 421/844] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:57 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:57.965599 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c48e72f1-7674-4aa3-9b48-953c44d152d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Action: 'create', calling method: .version_select at 0x7f5be4207550>, body: {"keypair": {"name": "tempest-keypair-1458308407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2PqLQ7HMSahKTgaAEW5LVXx7DHeV28va/Konz+SQGd/5ARWXFJWh30ZumuBbPg66nN8jMhj3PUddRbJD3sh4YbAmSFh5/upRHR8mivrbs7WweWbOSC6OHZxuP/WZW8jQ=="}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:57.980896 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-c48e72f1-7674-4aa3-9b48-953c44d152d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Getting quotas for project bc4476b1f4b84b5593ff2650592b9fb7. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:58:57.986099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-c48e72f1-7674-4aa3-9b48-953c44d152d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Getting quotas for user 75642df28f5d4301b979f39482a9a11d and project bc4476b1f4b84b5593ff2650592b9fb7. Resources: {'key_pairs'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:58:58.010527 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c48e72f1-7674-4aa3-9b48-953c44d152d9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048113 Sep 08 13:58:58.011228 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 424/845] 10.222.0.55 () {62 vars in 1200 bytes} [Thu Sep 8 13:58:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 13:58:58.460187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-80f34ac7-ae71-4e77-a946-25940de9d0b0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: .version_select at 0x7f5be4380940>, body: {"keypair": {"name": "tempest-keypair-393235544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCb9xLFdrwbV1AA4Jy6hXufKSr4f4RXdHSMfdgKxDPiBwLq5/c4/Z1pHtN8brG3KESnOA4ZgWp6JOjpBWcehTg5i6Ib0WlTAlqo21OxTCSeHFd2VePhq7Q1E2RoaTO5OIw=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:58.476447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-80f34ac7-ae71-4e77-a946-25940de9d0b0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for project b4ca185497284e9780eba8fc2e713d6e. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:58:58.480262 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-80f34ac7-ae71-4e77-a946-25940de9d0b0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for user 2e48a8c1b91142cf9d1af17f28e41961 and project b4ca185497284e9780eba8fc2e713d6e. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:58:58.504953 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-80f34ac7-ae71-4e77-a946-25940de9d0b0 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048567 Sep 08 13:58:58.506217 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 422/846] 10.222.0.55 () {60 vars in 1159 bytes} [Thu Sep 8 13:58:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:58.773023 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:58.774403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 21bead64-8c72-4cb8-806b-f68b2fc593cc] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:58.781189 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:58.781665 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:58.782119 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:58.782815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:58.783262 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:58.783672 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:58.797561 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] HTTP exception thrown: Instance 21bead64-8c72-4cb8-806b-f68b2fc593cc could not be found. Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Request method failure captured: Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc HTTP/1.1 Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOqXoy_jlQIcZGQ-ASMeE8UfdjfJ-ZihXwARCECew2uUYEJfMfCz4Rpk1P8GXDhQweMznN18TYBN46-yUNN374-KOAFI0-TsMI8X4KAfqsDS34nfplWRAAQSTE1yMbeUr-5QSIeMgvOItm1HaVoYnDByAwRWoy1gn4Ja99jHM4ADiM Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 127bce2080d54fe4871b5aaa6cc394b5 Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:58:58.799403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_127bce2080d54fe4871b5aaa6cc394b5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 127bce2080d54fe4871b5aaa6cc394b5 Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-ServerRescueNegativeTestJSON-486286006-project Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 9f07158e4fd1430e839a1592e1e11b58 Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-486286006-project Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 21bead64-8c72-4cb8-806b-f68b2fc593cc could not be found. Sep 08 13:58:58.800972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '21bead64-8c72-4cb8-806b-f68b2fc593cc'} Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21bead64-8c72-4cb8-806b-f68b2fc593cc could not be found. Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:58:58.802329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21bead64-8c72-4cb8-806b-f68b2fc593cc could not be found. Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21bead64-8c72-4cb8-806b-f68b2fc593cc could not be found. Sep 08 13:58:58.803699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:58:58.805106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Returning 404 to user: Instance 21bead64-8c72-4cb8-806b-f68b2fc593cc could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:58:58.805106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-44da910f-d9cb-45e9-88d0-f857e8ce7677 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc" status: 404 len: 111 microversion: 2.1 time: 0.032253 Sep 08 13:58:58.805106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 425/847] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:58 2022] GET /compute/v2.1/servers/21bead64-8c72-4cb8-806b-f68b2fc593cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:58.808716 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d42145ae-72b6-4a0f-b693-9e821e5ae92e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:58.809785 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d3f523ed-4c29-411b-a135-6b488dc9c91d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '.version_select at 0x7f5be4207820>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:58.810551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d42145ae-72b6-4a0f-b693-9e821e5ae92e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:58.819185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d42145ae-72b6-4a0f-b693-9e821e5ae92e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:58.820378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d42145ae-72b6-4a0f-b693-9e821e5ae92e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:58.820893 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d42145ae-72b6-4a0f-b693-9e821e5ae92e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:58.821719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d42145ae-72b6-4a0f-b693-9e821e5ae92e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:58.822447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d42145ae-72b6-4a0f-b693-9e821e5ae92e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:58.823045 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d42145ae-72b6-4a0f-b693-9e821e5ae92e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:58.828634 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d3f523ed-4c29-411b-a135-6b488dc9c91d tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-60288270" status: 202 len: 0 microversion: 2.1 time: 0.022727 Sep 08 13:58:58.829206 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 426/848] 10.222.0.55 () {58 vars in 1215 bytes} [Thu Sep 8 13:58:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-60288270 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:58:59.040064 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d42145ae-72b6-4a0f-b693-9e821e5ae92e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:59.044057 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:59.049604 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d42145ae-72b6-4a0f-b693-9e821e5ae92e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1363 microversion: 2.1 time: 0.251040 Sep 08 13:58:59.050560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 423/849] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:58 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:59.638585 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-34e9158e-e18d-4abd-a624-da6a6138bb78 req-2ce154c8-a239-486f-86e4-e138897bb15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e839a72-e12e-4617-88c9-ed12f748c399", "name": "network-vif-plugged", "status": "completed", "tag": "1e7eb6da-3323-4042-81a8-99078c8d7b4e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:59.651490 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-34e9158e-e18d-4abd-a624-da6a6138bb78 req-2ce154c8-a239-486f-86e4-e138897bb15f service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:59.652393 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-34e9158e-e18d-4abd-a624-da6a6138bb78 req-2ce154c8-a239-486f-86e4-e138897bb15f service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:59.652888 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-34e9158e-e18d-4abd-a624-da6a6138bb78 req-2ce154c8-a239-486f-86e4-e138897bb15f service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:59.667603 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-34e9158e-e18d-4abd-a624-da6a6138bb78 req-2ce154c8-a239-486f-86e4-e138897bb15f service nova] Creating event network-vif-plugged:1e7eb6da-3323-4042-81a8-99078c8d7b4e for instance 9e839a72-e12e-4617-88c9-ed12f748c399 on hv-cinder-82002 Sep 08 13:58:59.673549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-34e9158e-e18d-4abd-a624-da6a6138bb78 req-2ce154c8-a239-486f-86e4-e138897bb15f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117127 Sep 08 13:58:59.674316 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 427/850] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:00.064917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1942753294", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c9b3d05-20f8-440e-89b3-587b430f97a5"}], "security_groups": [{"name": "tempest-securitygroup--1427075975"}], "key_name": "tempest-keypair-1458308407", "user_data": "}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:00.078635 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2abaad94-25fa-4087-a3f9-52fa7e469893 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:00.079367 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2abaad94-25fa-4087-a3f9-52fa7e469893 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:00.086428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2abaad94-25fa-4087-a3f9-52fa7e469893 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:00.087362 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2abaad94-25fa-4087-a3f9-52fa7e469893 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:00.088422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2abaad94-25fa-4087-a3f9-52fa7e469893 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:00.089151 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2abaad94-25fa-4087-a3f9-52fa7e469893 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:00.090121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2abaad94-25fa-4087-a3f9-52fa7e469893 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:00.090801 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2abaad94-25fa-4087-a3f9-52fa7e469893 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:00.305098 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] validate_networks() for [('1c9b3d05-20f8-440e-89b3-587b430f97a5', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:59:00.410284 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2abaad94-25fa-4087-a3f9-52fa7e469893 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:00.417930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2abaad94-25fa-4087-a3f9-52fa7e469893 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1363 microversion: 2.1 time: 0.346847 Sep 08 13:59:00.418703 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 428/851] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:00 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:59:00.843597 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1393513702", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf5901ef-2ee5-4879-85aa-18770c77b80a"}], "security_groups": [{"name": "tempest-securitygroup--1235098839"}], "key_name": "tempest-keypair-393235544", "user_data": "}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:01.207698 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] validate_networks() for [('cf5901ef-2ee5-4879-85aa-18770c77b80a', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:59:01.211889 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:59:01.212373 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:59:01.212935 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:59:01.213347 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:59:01.213775 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:59:01.223519 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:01.223995 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:01.224428 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:01.225154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:01.225605 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:01.226052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:01.242446 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Getting quotas for project bc4476b1f4b84b5593ff2650592b9fb7. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:59:01.246467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Getting quotas for user 75642df28f5d4301b979f39482a9a11d and project bc4476b1f4b84b5593ff2650592b9fb7. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:59:01.257260 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:59:01.259615 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:59:01.306519 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e8b52dc1-2859-40c2-83f7-a51b7d9a112f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.246039 Sep 08 13:59:01.313427 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 424/852] 10.222.0.55 () {62 vars in 1188 bytes} [Thu Sep 8 13:59:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1248 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 13:59:01.319616 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e18724b7-4168-4ce4-a3cd-7625f174689a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:01.320344 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e18724b7-4168-4ce4-a3cd-7625f174689a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:01.383066 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e18724b7-4168-4ce4-a3cd-7625f174689a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:01.397295 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e18724b7-4168-4ce4-a3cd-7625f174689a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:01.399561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e18724b7-4168-4ce4-a3cd-7625f174689a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:01.400683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e18724b7-4168-4ce4-a3cd-7625f174689a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1282 microversion: 2.20 time: 0.085104 Sep 08 13:59:01.401241 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 425/853] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:01 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1282 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:59:01.445636 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b41f92da-9c1e-419e-9c38-bcc2100b5364 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:01.446600 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b41f92da-9c1e-419e-9c38-bcc2100b5364 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:01.453205 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41f92da-9c1e-419e-9c38-bcc2100b5364 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:01.453901 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41f92da-9c1e-419e-9c38-bcc2100b5364 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:01.454532 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41f92da-9c1e-419e-9c38-bcc2100b5364 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:01.455239 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41f92da-9c1e-419e-9c38-bcc2100b5364 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:01.455761 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41f92da-9c1e-419e-9c38-bcc2100b5364 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:01.456119 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b41f92da-9c1e-419e-9c38-bcc2100b5364 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:01.664639 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b41f92da-9c1e-419e-9c38-bcc2100b5364 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:01.673397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b41f92da-9c1e-419e-9c38-bcc2100b5364 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1363 microversion: 2.1 time: 0.231460 Sep 08 13:59:01.674232 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 426/854] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:01 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:01.709252 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:59:01.709814 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:59:01.710354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:59:01.710698 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:59:01.711100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:59:01.721297 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:01.721802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:01.722276 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:01.722976 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:01.723420 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:01.723837 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:01.740071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for project b4ca185497284e9780eba8fc2e713d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:59:01.744016 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Getting quotas for user 2e48a8c1b91142cf9d1af17f28e41961 and project b4ca185497284e9780eba8fc2e713d6e. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:59:01.755296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:59:01.757570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:59:01.803168 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2550b090-cbb8-41a5-a59f-7a876a380534 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.964630 Sep 08 13:59:01.803807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 429/855] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 13:59:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:59:01.815415 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-64d84d43-e7fa-4c99-9b47-36dafa363c14 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:01.816026 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-64d84d43-e7fa-4c99-9b47-36dafa363c14 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:01.873522 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-64d84d43-e7fa-4c99-9b47-36dafa363c14 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:01.880503 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-64d84d43-e7fa-4c99-9b47-36dafa363c14 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1241 microversion: 2.1 time: 0.069002 Sep 08 13:59:01.881154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 427/856] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:01 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:02.025758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-de4e86f9-ef84-4b97-8acd-b3f80f71046a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:02.026410 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-de4e86f9-ef84-4b97-8acd-b3f80f71046a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:02.033025 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de4e86f9-ef84-4b97-8acd-b3f80f71046a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.033578 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de4e86f9-ef84-4b97-8acd-b3f80f71046a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.034292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de4e86f9-ef84-4b97-8acd-b3f80f71046a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.034873 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de4e86f9-ef84-4b97-8acd-b3f80f71046a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.035387 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de4e86f9-ef84-4b97-8acd-b3f80f71046a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.035811 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-de4e86f9-ef84-4b97-8acd-b3f80f71046a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.062420 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-de4e86f9-ef84-4b97-8acd-b3f80f71046a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:59:02.142300 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-de4e86f9-ef84-4b97-8acd-b3f80f71046a tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "DELETE /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 204 len: 0 microversion: 2.1 time: 0.119952 Sep 08 13:59:02.146052 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 430/857] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:59:02 2022] DELETE /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:59:02.152200 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-19e47737-8bcd-4588-9c65-4bc9e64d027f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:02.153867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-19e47737-8bcd-4588-9c65-4bc9e64d027f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:02.162538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e47737-8bcd-4588-9c65-4bc9e64d027f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.163065 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e47737-8bcd-4588-9c65-4bc9e64d027f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.163821 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e47737-8bcd-4588-9c65-4bc9e64d027f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.164621 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e47737-8bcd-4588-9c65-4bc9e64d027f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.165078 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e47737-8bcd-4588-9c65-4bc9e64d027f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.165567 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19e47737-8bcd-4588-9c65-4bc9e64d027f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.314268 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-19e47737-8bcd-4588-9c65-4bc9e64d027f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:02.321843 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-19e47737-8bcd-4588-9c65-4bc9e64d027f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1507 microversion: 2.1 time: 0.174487 Sep 08 13:59:02.322399 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 428/858] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:02 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:02.426718 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:02.427411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:02.433277 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.433774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.434209 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.434890 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.435334 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.435750 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.501478 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:02.509597 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:02.510988 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:02.512071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c5392af6-d7f0-41e0-a147-7c3db8e89cf3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1278 microversion: 2.20 time: 0.089634 Sep 08 13:59:02.513177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 431/859] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:02 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:59:02.697164 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb21a45d-87c3-4f45-ac4f-e8a70739e784 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:02.697805 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb21a45d-87c3-4f45-ac4f-e8a70739e784 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:02.704197 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21a45d-87c3-4f45-ac4f-e8a70739e784 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.704685 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21a45d-87c3-4f45-ac4f-e8a70739e784 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.705123 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21a45d-87c3-4f45-ac4f-e8a70739e784 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.705840 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21a45d-87c3-4f45-ac4f-e8a70739e784 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.706301 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21a45d-87c3-4f45-ac4f-e8a70739e784 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.706731 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb21a45d-87c3-4f45-ac4f-e8a70739e784 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.832481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb21a45d-87c3-4f45-ac4f-e8a70739e784 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:02.840480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb21a45d-87c3-4f45-ac4f-e8a70739e784 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1549 microversion: 2.1 time: 0.147381 Sep 08 13:59:02.841606 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 429/860] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:02 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:02.863169 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b66f69e2-1729-4b27-ad5d-40a084895f13 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:02.863664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b66f69e2-1729-4b27-ad5d-40a084895f13 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:02.869641 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b66f69e2-1729-4b27-ad5d-40a084895f13 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.870165 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b66f69e2-1729-4b27-ad5d-40a084895f13 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.870598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b66f69e2-1729-4b27-ad5d-40a084895f13 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.871310 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b66f69e2-1729-4b27-ad5d-40a084895f13 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.871786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b66f69e2-1729-4b27-ad5d-40a084895f13 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.872209 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b66f69e2-1729-4b27-ad5d-40a084895f13 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.903865 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-309ea336-00b9-422f-a538-b59e202872e1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:02.904481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-309ea336-00b9-422f-a538-b59e202872e1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:02.910894 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-309ea336-00b9-422f-a538-b59e202872e1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.911120 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-309ea336-00b9-422f-a538-b59e202872e1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.911549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-309ea336-00b9-422f-a538-b59e202872e1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.912253 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-309ea336-00b9-422f-a538-b59e202872e1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:02.912715 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-309ea336-00b9-422f-a538-b59e202872e1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:02.913138 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-309ea336-00b9-422f-a538-b59e202872e1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:02.949051 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b66f69e2-1729-4b27-ad5d-40a084895f13 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089691 Sep 08 13:59:02.949685 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 432/861] 10.222.0.55 () {58 vars in 1275 bytes} [Thu Sep 8 13:59:02 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:02.982458 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-309ea336-00b9-422f-a538-b59e202872e1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:02.990027 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-309ea336-00b9-422f-a538-b59e202872e1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1245 microversion: 2.1 time: 0.090918 Sep 08 13:59:02.990591 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 430/862] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:02 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:59:03.345713 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c839bda9-0f80-4b70-91b2-89e25d263c59 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:03.346348 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c839bda9-0f80-4b70-91b2-89e25d263c59 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:03.352205 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c839bda9-0f80-4b70-91b2-89e25d263c59 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:03.352687 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c839bda9-0f80-4b70-91b2-89e25d263c59 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:03.353145 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c839bda9-0f80-4b70-91b2-89e25d263c59 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:03.353856 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c839bda9-0f80-4b70-91b2-89e25d263c59 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:03.354309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c839bda9-0f80-4b70-91b2-89e25d263c59 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:03.354734 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c839bda9-0f80-4b70-91b2-89e25d263c59 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:03.487911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c839bda9-0f80-4b70-91b2-89e25d263c59 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:03.495734 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c839bda9-0f80-4b70-91b2-89e25d263c59 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1507 microversion: 2.1 time: 0.154933 Sep 08 13:59:03.496440 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 433/863] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:03 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:03.537526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:03.538171 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:03.545132 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:03.545619 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:03.546136 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:03.546836 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:03.547467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:03.547895 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:03.608688 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:03.616798 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:03.618259 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:03.619362 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-727b5c43-c26f-4b66-9394-4cd9a60b68f2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1278 microversion: 2.20 time: 0.085760 Sep 08 13:59:03.619924 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 431/864] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:03 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:59:03.904380 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-e033ec1f-05ba-4868-a53a-15f20734246b req-cedc875c-8ece-4d7f-aa02-b262546e7455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e839a72-e12e-4617-88c9-ed12f748c399", "tag": "1e7eb6da-3323-4042-81a8-99078c8d7b4e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:03.917302 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e033ec1f-05ba-4868-a53a-15f20734246b req-cedc875c-8ece-4d7f-aa02-b262546e7455 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:03.918044 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e033ec1f-05ba-4868-a53a-15f20734246b req-cedc875c-8ece-4d7f-aa02-b262546e7455 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:03.918583 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-e033ec1f-05ba-4868-a53a-15f20734246b req-cedc875c-8ece-4d7f-aa02-b262546e7455 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:03.930347 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-e033ec1f-05ba-4868-a53a-15f20734246b req-cedc875c-8ece-4d7f-aa02-b262546e7455 service nova] Creating event network-changed:1e7eb6da-3323-4042-81a8-99078c8d7b4e for instance 9e839a72-e12e-4617-88c9-ed12f748c399 on hv-cinder-82002 Sep 08 13:59:03.936233 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-e033ec1f-05ba-4868-a53a-15f20734246b req-cedc875c-8ece-4d7f-aa02-b262546e7455 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036556 Sep 08 13:59:03.937259 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 434/865] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:04.012427 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-56ecaa97-9eb6-4525-8446-8d4ff94234bf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:04.013526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-56ecaa97-9eb6-4525-8446-8d4ff94234bf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:04.019675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56ecaa97-9eb6-4525-8446-8d4ff94234bf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:04.020157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56ecaa97-9eb6-4525-8446-8d4ff94234bf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:04.020595 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56ecaa97-9eb6-4525-8446-8d4ff94234bf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:04.021296 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56ecaa97-9eb6-4525-8446-8d4ff94234bf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:04.021781 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56ecaa97-9eb6-4525-8446-8d4ff94234bf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:04.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-56ecaa97-9eb6-4525-8446-8d4ff94234bf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:04.085204 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-56ecaa97-9eb6-4525-8446-8d4ff94234bf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:04.094050 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-56ecaa97-9eb6-4525-8446-8d4ff94234bf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1237 microversion: 2.1 time: 0.085226 Sep 08 13:59:04.094666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 432/866] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:04 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:04.520380 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c61716c7-473f-4a4d-be50-1e2e83751d49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:04.521075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c61716c7-473f-4a4d-be50-1e2e83751d49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:04.528987 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c61716c7-473f-4a4d-be50-1e2e83751d49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:04.529697 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c61716c7-473f-4a4d-be50-1e2e83751d49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:04.530294 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c61716c7-473f-4a4d-be50-1e2e83751d49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:04.531174 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c61716c7-473f-4a4d-be50-1e2e83751d49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:04.531775 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c61716c7-473f-4a4d-be50-1e2e83751d49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:04.532342 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c61716c7-473f-4a4d-be50-1e2e83751d49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:04.648735 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:04.650191 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:04.658986 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:04.659840 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:04.660538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:04.661568 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:04.662799 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:04.663444 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:04.761997 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:04.775252 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:04.776654 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:04.778973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e5161565-83ec-452d-a3f9-96511a34c77e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1334 microversion: 2.20 time: 0.137658 Sep 08 13:59:04.785575 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 433/867] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:04 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1334 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:59:04.837952 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c61716c7-473f-4a4d-be50-1e2e83751d49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:04.847285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c61716c7-473f-4a4d-be50-1e2e83751d49 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1507 microversion: 2.1 time: 0.331862 Sep 08 13:59:04.853818 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 435/868] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:04 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:05.030388 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-2ee6c696-a9c5-4204-abec-aa9bc08fb930 req-c23c1eb6-7ef5-4776-baaa-eb3289bb048a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17665f83-a581-4f16-9275-45bce05f5f49", "name": "network-vif-deleted", "tag": "5c7e423f-8bb5-4a1a-a739-7918f898d812"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:05.039994 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2ee6c696-a9c5-4204-abec-aa9bc08fb930 req-c23c1eb6-7ef5-4776-baaa-eb3289bb048a service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:05.040476 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2ee6c696-a9c5-4204-abec-aa9bc08fb930 req-c23c1eb6-7ef5-4776-baaa-eb3289bb048a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:05.040909 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2ee6c696-a9c5-4204-abec-aa9bc08fb930 req-c23c1eb6-7ef5-4776-baaa-eb3289bb048a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:05.056533 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-2ee6c696-a9c5-4204-abec-aa9bc08fb930 req-c23c1eb6-7ef5-4776-baaa-eb3289bb048a service nova] Creating event network-vif-deleted:5c7e423f-8bb5-4a1a-a739-7918f898d812 for instance 17665f83-a581-4f16-9275-45bce05f5f49 on hv-cinder-82002 Sep 08 13:59:05.064752 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-2ee6c696-a9c5-4204-abec-aa9bc08fb930 req-c23c1eb6-7ef5-4776-baaa-eb3289bb048a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038528 Sep 08 13:59:05.070267 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 434/869] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:05.120295 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f6b6dade-c370-45f7-8f67-cabef249624c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:05.120949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f6b6dade-c370-45f7-8f67-cabef249624c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:05.128862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b6dade-c370-45f7-8f67-cabef249624c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:05.130072 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b6dade-c370-45f7-8f67-cabef249624c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:05.130949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b6dade-c370-45f7-8f67-cabef249624c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:05.132171 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b6dade-c370-45f7-8f67-cabef249624c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:05.133958 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b6dade-c370-45f7-8f67-cabef249624c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:05.134615 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f6b6dade-c370-45f7-8f67-cabef249624c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:05.245350 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f6b6dade-c370-45f7-8f67-cabef249624c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:05.259937 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f6b6dade-c370-45f7-8f67-cabef249624c tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1237 microversion: 2.1 time: 0.141118 Sep 08 13:59:05.259937 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 436/870] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:05 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1237 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:05.805404 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:05.806140 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:05.814700 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:05.815194 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:05.815634 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:05.816348 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:05.816803 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:05.817231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:05.871938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:05.872622 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:05.879780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:05.882212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:05.882212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:05.882212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:05.882212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:05.882604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:05.887128 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:05.908720 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:05.919035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:05.920548 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:05.921892 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7cb69b55-b9d5-4823-b59d-ccfe79c21df9 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1340 microversion: 2.20 time: 0.120949 Sep 08 13:59:05.922463 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 435/871] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:05 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1340 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:59:05.922805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:05.923300 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:05.923755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:05.924225 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lazy-loading 'fault' on Instance uuid 17665f83-a581-4f16-9275-45bce05f5f49 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:59:05.994244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:06.002565 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-97cf5a8f-45b2-4ada-b482-9e8bdf5a96a9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1311 microversion: 2.1 time: 0.134996 Sep 08 13:59:06.003142 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 437/872] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:05 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1311 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:59:06.289239 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d88c603-5e7c-43a3-8d2d-41c9072c4151 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:06.290140 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0d88c603-5e7c-43a3-8d2d-41c9072c4151 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:06.303581 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d88c603-5e7c-43a3-8d2d-41c9072c4151 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:06.304467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d88c603-5e7c-43a3-8d2d-41c9072c4151 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:06.306000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d88c603-5e7c-43a3-8d2d-41c9072c4151 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:06.311205 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d88c603-5e7c-43a3-8d2d-41c9072c4151 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:06.312028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d88c603-5e7c-43a3-8d2d-41c9072c4151 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:06.312689 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0d88c603-5e7c-43a3-8d2d-41c9072c4151 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:06.394200 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0d88c603-5e7c-43a3-8d2d-41c9072c4151 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:06.407716 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d88c603-5e7c-43a3-8d2d-41c9072c4151 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1301 microversion: 2.1 time: 0.122499 Sep 08 13:59:06.408299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 436/873] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:06 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1301 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:06.948404 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:06.949019 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:06.956117 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:06.956776 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:06.957215 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:06.957957 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:06.958410 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:06.958844 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:07.026318 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:07.027327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:07.043337 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:07.044419 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:07.044858 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:07.045565 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:07.046257 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:07.047498 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:07.084904 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:07.085695 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:07.086313 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:07.087704 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lazy-loading 'fault' on Instance uuid 17665f83-a581-4f16-9275-45bce05f5f49 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:59:07.149376 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:07.157997 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9600d33c-fce4-4ca7-92ca-8ca6cb53867c tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 200 len: 1311 microversion: 2.1 time: 0.135460 Sep 08 13:59:07.159013 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 437/874] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:07 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 1311 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:07.202591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:07.210771 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:07.212212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:07.213324 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6bf31e4c-8c48-4ea9-8cc0-d7bfeb33491e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1408 microversion: 2.20 time: 0.268840 Sep 08 13:59:07.213919 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 438/875] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:06 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:59:07.256972 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-672e9b58-70e5-479b-b322-3b8e58a71cfc req-c49595fc-1ea9-4f52-9e34-927f47f71be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3625263b-e16f-4c5c-a20a-591dca9ca140", "tag": "daea8158-0875-402f-9603-ddb321067a70"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:07.268733 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-672e9b58-70e5-479b-b322-3b8e58a71cfc req-c49595fc-1ea9-4f52-9e34-927f47f71be4 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:07.269251 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-672e9b58-70e5-479b-b322-3b8e58a71cfc req-c49595fc-1ea9-4f52-9e34-927f47f71be4 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:07.269683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-672e9b58-70e5-479b-b322-3b8e58a71cfc req-c49595fc-1ea9-4f52-9e34-927f47f71be4 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:07.285478 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-672e9b58-70e5-479b-b322-3b8e58a71cfc req-c49595fc-1ea9-4f52-9e34-927f47f71be4 service nova] Creating event network-changed:daea8158-0875-402f-9603-ddb321067a70 for instance 3625263b-e16f-4c5c-a20a-591dca9ca140 on hv-cinder-82002 Sep 08 13:59:07.290918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-672e9b58-70e5-479b-b322-3b8e58a71cfc req-c49595fc-1ea9-4f52-9e34-927f47f71be4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047694 Sep 08 13:59:07.292117 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 438/876] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:59:07.430960 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b50ad62d-ae64-4ca7-9f4d-a4af8d016d1d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:07.431569 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b50ad62d-ae64-4ca7-9f4d-a4af8d016d1d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:07.438418 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50ad62d-ae64-4ca7-9f4d-a4af8d016d1d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:07.438899 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50ad62d-ae64-4ca7-9f4d-a4af8d016d1d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:07.439322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50ad62d-ae64-4ca7-9f4d-a4af8d016d1d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:07.440235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50ad62d-ae64-4ca7-9f4d-a4af8d016d1d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:07.440681 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50ad62d-ae64-4ca7-9f4d-a4af8d016d1d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:07.441093 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b50ad62d-ae64-4ca7-9f4d-a4af8d016d1d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:07.680201 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b50ad62d-ae64-4ca7-9f4d-a4af8d016d1d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:07.690387 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b50ad62d-ae64-4ca7-9f4d-a4af8d016d1d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.262765 Sep 08 13:59:07.702598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 439/877] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:07 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:08.184918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:08.185641 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: 17665f83-a581-4f16-9275-45bce05f5f49] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:08.191689 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:08.192168 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:08.192603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:08.193300 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:08.193786 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:08.194191 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:08.207372 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] HTTP exception thrown: Instance 17665f83-a581-4f16-9275-45bce05f5f49 could not be found. Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Request method failure captured: Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 HTTP/1.1 Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOqXoy_jlQIcZGQ-ASMeE8UfdjfJ-ZihXwARCECew2uUYEJfMfCz4Rpk1P8GXDhQweMznN18TYBN46-yUNN374-KOAFI0-TsMI8X4KAfqsDS34nfplWRAAQSTE1yMbeUr-5QSIeMgvOItm1HaVoYnDByAwRWoy1gn4Ja99jHM4ADiM Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 127bce2080d54fe4871b5aaa6cc394b5 Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 13:59:08.209014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_127bce2080d54fe4871b5aaa6cc394b5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 127bce2080d54fe4871b5aaa6cc394b5 Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-ServerRescueNegativeTestJSON-486286006-project Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 9f07158e4fd1430e839a1592e1e11b58 Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-486286006-project Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 17665f83-a581-4f16-9275-45bce05f5f49 could not be found. Sep 08 13:59:08.210391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '17665f83-a581-4f16-9275-45bce05f5f49'} Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17665f83-a581-4f16-9275-45bce05f5f49 could not be found. Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:59:08.211154 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17665f83-a581-4f16-9275-45bce05f5f49 could not be found. Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17665f83-a581-4f16-9275-45bce05f5f49 could not be found. Sep 08 13:59:08.212435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 13:59:08.213527 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Returning 404 to user: Instance 17665f83-a581-4f16-9275-45bce05f5f49 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:59:08.213527 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0cca82e3-c741-4d88-9477-e919a59fe207 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49" status: 404 len: 111 microversion: 2.1 time: 0.031042 Sep 08 13:59:08.213527 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 439/878] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:08 2022] GET /compute/v2.1/servers/17665f83-a581-4f16-9275-45bce05f5f49 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:59:08.220611 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5a0a54c6-5ea5-4316-a2ff-71d46b803e33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:08.221094 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5a0a54c6-5ea5-4316-a2ff-71d46b803e33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:08.223959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:08.227599 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0a54c6-5ea5-4316-a2ff-71d46b803e33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:08.228082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0a54c6-5ea5-4316-a2ff-71d46b803e33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:08.228511 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0a54c6-5ea5-4316-a2ff-71d46b803e33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:08.229201 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0a54c6-5ea5-4316-a2ff-71d46b803e33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:08.229655 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0a54c6-5ea5-4316-a2ff-71d46b803e33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:08.230102 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5a0a54c6-5ea5-4316-a2ff-71d46b803e33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:08.239366 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:08.239976 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:08.245939 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:08.246423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:08.247365 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:08.248235 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:08.248845 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:08.249531 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:08.259523 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5a0a54c6-5ea5-4316-a2ff-71d46b803e33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:59:08.341613 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5a0a54c6-5ea5-4316-a2ff-71d46b803e33 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 204 len: 0 microversion: 2.1 time: 0.125677 Sep 08 13:59:08.345225 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 440/879] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 13:59:08 2022] DELETE /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:59:08.347397 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-28bda19c-8df1-4664-a8f1-263a077f0ca8 req-718297ac-0435-4264-aad1-a7fd1d24b10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5ce5ad-7f55-4482-bff3-96eb19463f07", "tag": "e14cb466-443e-415d-b932-45c6f7a15d37"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:08.356866 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-28bda19c-8df1-4664-a8f1-263a077f0ca8 req-718297ac-0435-4264-aad1-a7fd1d24b10b service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:08.357346 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-28bda19c-8df1-4664-a8f1-263a077f0ca8 req-718297ac-0435-4264-aad1-a7fd1d24b10b service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:08.357803 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-28bda19c-8df1-4664-a8f1-263a077f0ca8 req-718297ac-0435-4264-aad1-a7fd1d24b10b service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:08.368879 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-28bda19c-8df1-4664-a8f1-263a077f0ca8 req-718297ac-0435-4264-aad1-a7fd1d24b10b service nova] Creating event network-changed:e14cb466-443e-415d-b932-45c6f7a15d37 for instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 on hv-cinder-82002 Sep 08 13:59:08.374274 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-28bda19c-8df1-4664-a8f1-263a077f0ca8 req-718297ac-0435-4264-aad1-a7fd1d24b10b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030637 Sep 08 13:59:08.374869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 441/880] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:08.379889 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c28cada6-2cc4-40a3-bb0e-42192b834e8f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:08.380588 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c28cada6-2cc4-40a3-bb0e-42192b834e8f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:08.387034 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28cada6-2cc4-40a3-bb0e-42192b834e8f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:08.388090 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28cada6-2cc4-40a3-bb0e-42192b834e8f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:08.388531 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28cada6-2cc4-40a3-bb0e-42192b834e8f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:08.389226 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28cada6-2cc4-40a3-bb0e-42192b834e8f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:08.389717 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28cada6-2cc4-40a3-bb0e-42192b834e8f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:08.390137 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c28cada6-2cc4-40a3-bb0e-42192b834e8f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:08.400037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:08.408308 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:08.409800 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:08.410900 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2b2743c3-2eb4-450f-a078-676e33a1703c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1408 microversion: 2.20 time: 0.175997 Sep 08 13:59:08.411447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 440/881] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:08 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:59:08.518142 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c28cada6-2cc4-40a3-bb0e-42192b834e8f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:08.525716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c28cada6-2cc4-40a3-bb0e-42192b834e8f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.149761 Sep 08 13:59:08.526299 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 442/882] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:08 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:08.715416 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b1badb11-8750-4943-964e-edea94c45e55 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:08.716026 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b1badb11-8750-4943-964e-edea94c45e55 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:08.722068 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1badb11-8750-4943-964e-edea94c45e55 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:08.722547 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1badb11-8750-4943-964e-edea94c45e55 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:08.722978 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1badb11-8750-4943-964e-edea94c45e55 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:08.723657 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1badb11-8750-4943-964e-edea94c45e55 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:08.724106 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1badb11-8750-4943-964e-edea94c45e55 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:08.724526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1badb11-8750-4943-964e-edea94c45e55 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:08.852750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b1badb11-8750-4943-964e-edea94c45e55 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:08.861267 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b1badb11-8750-4943-964e-edea94c45e55 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.149921 Sep 08 13:59:08.861843 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 441/883] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:08 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:09.436132 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:09.436686 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:09.443119 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:09.443600 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:09.444032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:09.444720 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:09.445174 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:09.445593 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:09.548345 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c53f2040-1477-4d60-9e5c-376282247164 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:09.549038 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c53f2040-1477-4d60-9e5c-376282247164 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:09.555566 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53f2040-1477-4d60-9e5c-376282247164 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:09.556147 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53f2040-1477-4d60-9e5c-376282247164 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:09.556656 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53f2040-1477-4d60-9e5c-376282247164 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:09.557471 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53f2040-1477-4d60-9e5c-376282247164 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:09.557957 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53f2040-1477-4d60-9e5c-376282247164 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:09.558379 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c53f2040-1477-4d60-9e5c-376282247164 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:09.577557 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:09.585592 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:09.587064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:09.588171 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b47568e6-9a2d-4592-acf8-6d92f5f6a666 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1408 microversion: 2.20 time: 0.156197 Sep 08 13:59:09.588729 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 443/884] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:09 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:59:09.686441 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c53f2040-1477-4d60-9e5c-376282247164 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:09.696213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c53f2040-1477-4d60-9e5c-376282247164 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.151624 Sep 08 13:59:09.696787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 442/885] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:09 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:59:09.884048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-208da576-82b3-4950-af85-3225cc852585 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:09.884658 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-208da576-82b3-4950-af85-3225cc852585 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:09.891229 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-208da576-82b3-4950-af85-3225cc852585 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:09.891700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-208da576-82b3-4950-af85-3225cc852585 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:09.892127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-208da576-82b3-4950-af85-3225cc852585 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:09.892833 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-208da576-82b3-4950-af85-3225cc852585 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:09.893296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-208da576-82b3-4950-af85-3225cc852585 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:09.893698 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-208da576-82b3-4950-af85-3225cc852585 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:10.026309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-208da576-82b3-4950-af85-3225cc852585 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:10.033920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-208da576-82b3-4950-af85-3225cc852585 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.153634 Sep 08 13:59:10.034486 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 444/886] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:09 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:10.614087 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:10.614729 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:10.621133 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:10.622152 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:10.622588 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:10.623276 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:10.623727 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:10.624151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:10.722520 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-33f3d8d9-67bd-4bff-868e-ac9366ecda73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:10.723120 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-33f3d8d9-67bd-4bff-868e-ac9366ecda73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:10.729392 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f3d8d9-67bd-4bff-868e-ac9366ecda73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:10.729904 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f3d8d9-67bd-4bff-868e-ac9366ecda73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:10.730334 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f3d8d9-67bd-4bff-868e-ac9366ecda73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:10.731032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f3d8d9-67bd-4bff-868e-ac9366ecda73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:10.731479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f3d8d9-67bd-4bff-868e-ac9366ecda73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:10.731891 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-33f3d8d9-67bd-4bff-868e-ac9366ecda73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:10.751890 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:10.760215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:10.761666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:10.763385 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-784a9fbb-9068-42ce-ab66-a12dd201c50d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1408 microversion: 2.20 time: 0.152802 Sep 08 13:59:10.763938 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 443/887] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:10 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:59:10.863409 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-33f3d8d9-67bd-4bff-868e-ac9366ecda73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:10.871133 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-33f3d8d9-67bd-4bff-868e-ac9366ecda73 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.152376 Sep 08 13:59:10.871666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 445/888] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:10 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:59:11.056371 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-294fae81-03d3-4c27-85bf-d65af78297b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:11.057016 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-294fae81-03d3-4c27-85bf-d65af78297b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:11.063078 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294fae81-03d3-4c27-85bf-d65af78297b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:11.063554 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294fae81-03d3-4c27-85bf-d65af78297b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:11.063984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294fae81-03d3-4c27-85bf-d65af78297b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:11.064671 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294fae81-03d3-4c27-85bf-d65af78297b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:11.065125 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294fae81-03d3-4c27-85bf-d65af78297b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:11.065546 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-294fae81-03d3-4c27-85bf-d65af78297b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:11.193387 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-294fae81-03d3-4c27-85bf-d65af78297b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:11.196885 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:11.202542 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-294fae81-03d3-4c27-85bf-d65af78297b5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.150034 Sep 08 13:59:11.203102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 444/889] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:11 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:11.788638 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:11.789277 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:11.791833 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:11.792490 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=10 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:11.798959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:11.799443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:11.799868 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:11.800573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:11.801015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:11.801425 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:11.898606 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d3333b1a-87c5-4d71-95ad-dc5739ffbf7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:11.900281 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d3333b1a-87c5-4d71-95ad-dc5739ffbf7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:11.907809 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:11.909077 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=14 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:11.910875 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3333b1a-87c5-4d71-95ad-dc5739ffbf7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:11.912133 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3333b1a-87c5-4d71-95ad-dc5739ffbf7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:11.912233 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3333b1a-87c5-4d71-95ad-dc5739ffbf7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:11.912905 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3333b1a-87c5-4d71-95ad-dc5739ffbf7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:11.913409 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3333b1a-87c5-4d71-95ad-dc5739ffbf7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:11.914048 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d3333b1a-87c5-4d71-95ad-dc5739ffbf7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:12.026632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:12.035534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:12.036980 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:12.038155 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-14bee288-1abd-4b09-a588-c5fffab5088d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1408 microversion: 2.20 time: 0.253403 Sep 08 13:59:12.038757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 446/890] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:11 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:59:12.080199 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d3333b1a-87c5-4d71-95ad-dc5739ffbf7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:12.088150 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d3333b1a-87c5-4d71-95ad-dc5739ffbf7f tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.196305 Sep 08 13:59:12.089014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 445/891] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:11 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:12.225897 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d1e6a9df-b557-440a-98be-c9ba16d4b415 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:12.226533 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d1e6a9df-b557-440a-98be-c9ba16d4b415 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:12.232464 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1e6a9df-b557-440a-98be-c9ba16d4b415 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:12.232943 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1e6a9df-b557-440a-98be-c9ba16d4b415 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:12.233367 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1e6a9df-b557-440a-98be-c9ba16d4b415 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:12.234077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1e6a9df-b557-440a-98be-c9ba16d4b415 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:12.234521 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1e6a9df-b557-440a-98be-c9ba16d4b415 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:12.234933 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d1e6a9df-b557-440a-98be-c9ba16d4b415 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:12.808420 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d1e6a9df-b557-440a-98be-c9ba16d4b415 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:12.816623 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d1e6a9df-b557-440a-98be-c9ba16d4b415 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.594816 Sep 08 13:59:12.817188 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 447/892] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:12 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:13.064075 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:13.064600 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:13.067982 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:13.071839 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:13.072332 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:13.072765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:13.074277 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:13.075484 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:13.075916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:13.112912 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f243fa0c-616b-4da1-b6cc-a979239813b9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:13.113526 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f243fa0c-616b-4da1-b6cc-a979239813b9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:13.119982 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f243fa0c-616b-4da1-b6cc-a979239813b9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:13.120465 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f243fa0c-616b-4da1-b6cc-a979239813b9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:13.120896 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f243fa0c-616b-4da1-b6cc-a979239813b9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:13.121642 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f243fa0c-616b-4da1-b6cc-a979239813b9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:13.122670 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f243fa0c-616b-4da1-b6cc-a979239813b9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:13.123093 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f243fa0c-616b-4da1-b6cc-a979239813b9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:13.410232 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:13.418128 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:13.419595 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:13.420709 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-aefed3da-2e40-4480-810f-596d0e500469 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1408 microversion: 2.20 time: 0.360651 Sep 08 13:59:13.421273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 446/893] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:13 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1408 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:59:13.492014 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f243fa0c-616b-4da1-b6cc-a979239813b9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:13.500808 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f243fa0c-616b-4da1-b6cc-a979239813b9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1521 microversion: 2.1 time: 0.391820 Sep 08 13:59:13.501405 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 448/894] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:13 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:13.574018 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-79e091a6-1016-4127-85d3-2278db9925b1 req-da8b095a-a882-4767-a161-efac4d250c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c", "name": "network-vif-deleted", "tag": "8264f39d-725c-426b-913c-05ab5ad2087e"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:13.585137 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-79e091a6-1016-4127-85d3-2278db9925b1 req-da8b095a-a882-4767-a161-efac4d250c08 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:13.585785 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-79e091a6-1016-4127-85d3-2278db9925b1 req-da8b095a-a882-4767-a161-efac4d250c08 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:13.586219 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-79e091a6-1016-4127-85d3-2278db9925b1 req-da8b095a-a882-4767-a161-efac4d250c08 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:13.599301 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-79e091a6-1016-4127-85d3-2278db9925b1 req-da8b095a-a882-4767-a161-efac4d250c08 service nova] Creating event network-vif-deleted:8264f39d-725c-426b-913c-05ab5ad2087e for instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c on hv-cinder-82002 Sep 08 13:59:13.608876 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-79e091a6-1016-4127-85d3-2278db9925b1 req-da8b095a-a882-4767-a161-efac4d250c08 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038334 Sep 08 13:59:13.609861 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 447/895] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:13.840240 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b1db9026-3727-441e-b31b-f7ac01fc28c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:13.840854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b1db9026-3727-441e-b31b-f7ac01fc28c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:13.848577 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1db9026-3727-441e-b31b-f7ac01fc28c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:13.849476 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1db9026-3727-441e-b31b-f7ac01fc28c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:13.850175 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1db9026-3727-441e-b31b-f7ac01fc28c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:13.850895 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1db9026-3727-441e-b31b-f7ac01fc28c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:13.851344 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1db9026-3727-441e-b31b-f7ac01fc28c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:13.851834 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b1db9026-3727-441e-b31b-f7ac01fc28c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:13.914418 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-cf65da74-f749-4749-ac39-3a04f6125830 req-160ddc86-d3f8-4d72-8552-4161bca6e62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3625263b-e16f-4c5c-a20a-591dca9ca140", "name": "network-vif-plugged", "status": "completed", "tag": "daea8158-0875-402f-9603-ddb321067a70"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:13.927677 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cf65da74-f749-4749-ac39-3a04f6125830 req-160ddc86-d3f8-4d72-8552-4161bca6e62e service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:13.928277 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cf65da74-f749-4749-ac39-3a04f6125830 req-160ddc86-d3f8-4d72-8552-4161bca6e62e service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:13.928884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-cf65da74-f749-4749-ac39-3a04f6125830 req-160ddc86-d3f8-4d72-8552-4161bca6e62e service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:13.950226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-cf65da74-f749-4749-ac39-3a04f6125830 req-160ddc86-d3f8-4d72-8552-4161bca6e62e service nova] Creating event network-vif-plugged:daea8158-0875-402f-9603-ddb321067a70 for instance 3625263b-e16f-4c5c-a20a-591dca9ca140 on hv-cinder-82002 Sep 08 13:59:13.955327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-cf65da74-f749-4749-ac39-3a04f6125830 req-160ddc86-d3f8-4d72-8552-4161bca6e62e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049087 Sep 08 13:59:13.956018 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 448/896] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:14.021056 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b1db9026-3727-441e-b31b-f7ac01fc28c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:14.030676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b1db9026-3727-441e-b31b-f7ac01fc28c4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.194592 Sep 08 13:59:14.031247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 449/897] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:13 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:14.447087 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:14.447769 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:14.454988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:14.455462 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:14.455895 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:14.456580 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:14.457026 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:14.457443 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:14.524612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:14.525331 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:14.531958 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:14.532443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:14.532880 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:14.533579 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:14.534090 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:14.534515 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:14.567192 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:14.567675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:14.568109 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:14.568557 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lazy-loading 'fault' on Instance uuid f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:59:14.624441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:14.627993 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:14.632261 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7f6838b6-f158-4ce7-80e4-329e0bf70ea9 tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1311 microversion: 2.1 time: 0.111560 Sep 08 13:59:14.633015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 450/898] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:14 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:59:14.639568 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:14.641020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:14.642161 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4b82c729-0743-4a45-8f5b-7e93bcb5b3b5 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1408 microversion: 2.20 time: 0.199838 Sep 08 13:59:14.643076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 449/899] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:14 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:59:15.054088 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b9a16ea-75cc-44d6-9ad4-85be0ad0767a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:15.054730 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b9a16ea-75cc-44d6-9ad4-85be0ad0767a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:15.061709 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b9a16ea-75cc-44d6-9ad4-85be0ad0767a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:15.062218 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b9a16ea-75cc-44d6-9ad4-85be0ad0767a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:15.062656 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b9a16ea-75cc-44d6-9ad4-85be0ad0767a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:15.063385 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b9a16ea-75cc-44d6-9ad4-85be0ad0767a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:15.063844 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b9a16ea-75cc-44d6-9ad4-85be0ad0767a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:15.064269 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b9a16ea-75cc-44d6-9ad4-85be0ad0767a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:15.246213 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5b9a16ea-75cc-44d6-9ad4-85be0ad0767a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:15.254785 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b9a16ea-75cc-44d6-9ad4-85be0ad0767a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.204865 Sep 08 13:59:15.255338 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 451/900] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:15 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:15.655167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:15.655778 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:15.662159 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:15.662663 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:15.663080 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:15.664022 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:15.664745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:15.665450 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:15.698796 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:15.699429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:15.699968 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:15.700535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lazy-loading 'fault' on Instance uuid f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:59:15.721983 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:15.722559 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:15.728514 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:15.729117 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:15.729553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:15.730266 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:15.730756 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:15.731703 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:15.735681 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:15.742428 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07158e4fd1430e839a1592e1e11b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127bce2080d54fe4871b5aaa6cc394b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:15.750352 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b938f438-85e6-4aab-98ce-556f12b540ee tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 200 len: 1311 microversion: 2.1 time: 0.098933 Sep 08 13:59:15.750878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 450/901] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:15 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:15.868176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:15.876161 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:15.877673 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:15.878779 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-147c6aa5-30a5-475b-9888-c3a8165889b1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1408 microversion: 2.20 time: 0.215985 Sep 08 13:59:15.879323 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 452/902] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:15 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:59:16.277984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-778d1554-64fb-4a88-a1ab-78f796830a07 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:16.278510 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-778d1554-64fb-4a88-a1ab-78f796830a07 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:16.284469 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-778d1554-64fb-4a88-a1ab-78f796830a07 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:16.284984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-778d1554-64fb-4a88-a1ab-78f796830a07 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:16.285394 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-778d1554-64fb-4a88-a1ab-78f796830a07 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:16.286109 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-778d1554-64fb-4a88-a1ab-78f796830a07 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:16.286563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-778d1554-64fb-4a88-a1ab-78f796830a07 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:16.286986 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-778d1554-64fb-4a88-a1ab-78f796830a07 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:16.419642 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-778d1554-64fb-4a88-a1ab-78f796830a07 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:16.427261 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-778d1554-64fb-4a88-a1ab-78f796830a07 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.153311 Sep 08 13:59:16.427827 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 451/903] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:16 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:16.772691 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:16.773321 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] [instance: f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:16.779731 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:16.780211 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:16.780646 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:16.781330 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:16.781803 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:16.782224 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:16.795568 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] HTTP exception thrown: Instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c could not be found. Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Request method failure captured: Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c HTTP/1.1 Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOqXoy_jlQIcZGQ-ASMeE8UfdjfJ-ZihXwARCECew2uUYEJfMfCz4Rpk1P8GXDhQweMznN18TYBN46-yUNN374-KOAFI0-TsMI8X4KAfqsDS34nfplWRAAQSTE1yMbeUr-5QSIeMgvOItm1HaVoYnDByAwRWoy1gn4Ja99jHM4ADiM Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 127bce2080d54fe4871b5aaa6cc394b5 Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 13:59:16.797200 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_127bce2080d54fe4871b5aaa6cc394b5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/127bce2080d54fe4871b5aaa6cc394b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 127bce2080d54fe4871b5aaa6cc394b5 Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-486286006 Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-ServerRescueNegativeTestJSON-486286006-project Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 9f07158e4fd1430e839a1592e1e11b58 Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-486286006-project Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c could not be found. Sep 08 13:59:16.798780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': 'f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c'} Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c could not be found. Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:59:16.799828 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c could not be found. Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c could not be found. Sep 08 13:59:16.801246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 13:59:16.802663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] Returning 404 to user: Instance f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:59:16.802663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-05699479-fd87-438f-8c61-63f5c16060ac tempest-ServerRescueNegativeTestJSON-486286006 tempest-ServerRescueNegativeTestJSON-486286006-project] 10.222.0.55 "GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c" status: 404 len: 111 microversion: 2.1 time: 0.029776 Sep 08 13:59:16.802663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 453/904] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:16 2022] GET /compute/v2.1/servers/f7b396f5-eec9-4df0-8dca-0f2ba1cbb42c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:59:16.904780 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:16.905402 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:16.912211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:16.912699 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:16.913131 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:16.913858 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:16.914314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:16.914739 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:17.047926 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:17.056467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:17.057986 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:17.059697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-34e6f00e-3f39-4488-9fa7-8034d8cbc05e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1408 microversion: 2.20 time: 0.159039 Sep 08 13:59:17.060273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 452/905] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:16 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:59:17.450633 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5303e2a5-051d-4575-9efa-5d103a3afa2a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:17.451246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5303e2a5-051d-4575-9efa-5d103a3afa2a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:17.457084 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5303e2a5-051d-4575-9efa-5d103a3afa2a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:17.457564 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5303e2a5-051d-4575-9efa-5d103a3afa2a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:17.458032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5303e2a5-051d-4575-9efa-5d103a3afa2a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:17.458719 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5303e2a5-051d-4575-9efa-5d103a3afa2a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:17.459164 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5303e2a5-051d-4575-9efa-5d103a3afa2a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:17.459581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5303e2a5-051d-4575-9efa-5d103a3afa2a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:17.590690 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5303e2a5-051d-4575-9efa-5d103a3afa2a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:17.598287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5303e2a5-051d-4575-9efa-5d103a3afa2a tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.151568 Sep 08 13:59:17.598845 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 454/906] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:17 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:18.084603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:18.085216 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:18.098869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:18.099543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:18.100253 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:18.101377 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:18.102412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:18.103082 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:18.242089 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:18.250307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:18.251741 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:18.252893 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be8d567e-bbbd-470b-a501-d3a4cd72b7c8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1600 microversion: 2.20 time: 0.172216 Sep 08 13:59:18.253448 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 453/907] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 13:59:18 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:59:18.278850 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-13b28f23-5853-4148-8cc8-675e7b350f24 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:18.279914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-13b28f23-5853-4148-8cc8-675e7b350f24 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:18.286627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13b28f23-5853-4148-8cc8-675e7b350f24 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:18.287118 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13b28f23-5853-4148-8cc8-675e7b350f24 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:18.287559 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13b28f23-5853-4148-8cc8-675e7b350f24 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:18.288294 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13b28f23-5853-4148-8cc8-675e7b350f24 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:18.288781 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13b28f23-5853-4148-8cc8-675e7b350f24 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:18.289234 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-13b28f23-5853-4148-8cc8-675e7b350f24 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:18.374120 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-13b28f23-5853-4148-8cc8-675e7b350f24 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099612 Sep 08 13:59:18.379721 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 455/908] 10.222.0.55 () {60 vars in 1316 bytes} [Thu Sep 8 13:59:18 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:59:18.627794 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6304cbe9-974c-4ad3-9ffb-de0b4ba324ec tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:18.628418 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6304cbe9-974c-4ad3-9ffb-de0b4ba324ec tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:18.634304 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6304cbe9-974c-4ad3-9ffb-de0b4ba324ec tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:18.634780 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6304cbe9-974c-4ad3-9ffb-de0b4ba324ec tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:18.635205 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6304cbe9-974c-4ad3-9ffb-de0b4ba324ec tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:18.635887 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6304cbe9-974c-4ad3-9ffb-de0b4ba324ec tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:18.636333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6304cbe9-974c-4ad3-9ffb-de0b4ba324ec tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:18.636754 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-6304cbe9-974c-4ad3-9ffb-de0b4ba324ec tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:18.774962 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-6304cbe9-974c-4ad3-9ffb-de0b4ba324ec tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:18.783002 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6304cbe9-974c-4ad3-9ffb-de0b4ba324ec tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.159026 Sep 08 13:59:18.783581 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 454/909] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:18 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:19.807829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-90f1af18-d4be-457d-8233-52fc78d0de40 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:19.809765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-90f1af18-d4be-457d-8233-52fc78d0de40 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:19.821760 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90f1af18-d4be-457d-8233-52fc78d0de40 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:19.822878 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90f1af18-d4be-457d-8233-52fc78d0de40 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:19.823581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90f1af18-d4be-457d-8233-52fc78d0de40 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:19.824801 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90f1af18-d4be-457d-8233-52fc78d0de40 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:19.825912 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90f1af18-d4be-457d-8233-52fc78d0de40 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:19.827066 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-90f1af18-d4be-457d-8233-52fc78d0de40 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:19.884529 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-1d4084c1-b301-4745-8a6b-f354e7eaa97d req-161b747e-19a1-4242-a08c-6cdd43616632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5ce5ad-7f55-4482-bff3-96eb19463f07", "name": "network-vif-plugged", "status": "completed", "tag": "e14cb466-443e-415d-b932-45c6f7a15d37"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:19.899182 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1d4084c1-b301-4745-8a6b-f354e7eaa97d req-161b747e-19a1-4242-a08c-6cdd43616632 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:19.899925 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1d4084c1-b301-4745-8a6b-f354e7eaa97d req-161b747e-19a1-4242-a08c-6cdd43616632 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:19.900491 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-1d4084c1-b301-4745-8a6b-f354e7eaa97d req-161b747e-19a1-4242-a08c-6cdd43616632 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:19.926641 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-1d4084c1-b301-4745-8a6b-f354e7eaa97d req-161b747e-19a1-4242-a08c-6cdd43616632 service nova] Creating event network-vif-plugged:e14cb466-443e-415d-b932-45c6f7a15d37 for instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 on hv-cinder-82002 Sep 08 13:59:19.932147 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-1d4084c1-b301-4745-8a6b-f354e7eaa97d req-161b747e-19a1-4242-a08c-6cdd43616632 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052130 Sep 08 13:59:19.933770 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 455/910] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:20.035244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-90f1af18-d4be-457d-8233-52fc78d0de40 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:20.042972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-90f1af18-d4be-457d-8233-52fc78d0de40 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.240161 Sep 08 13:59:20.044384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 456/911] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:19 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:20.235191 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-6751d0d5-1176-4587-ba97-f21adbc84f9e req-8c505fac-bd5f-4468-b9c6-72cfac098620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3625263b-e16f-4c5c-a20a-591dca9ca140", "tag": "daea8158-0875-402f-9603-ddb321067a70"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:20.248357 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6751d0d5-1176-4587-ba97-f21adbc84f9e req-8c505fac-bd5f-4468-b9c6-72cfac098620 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:20.248832 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6751d0d5-1176-4587-ba97-f21adbc84f9e req-8c505fac-bd5f-4468-b9c6-72cfac098620 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:20.249294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-6751d0d5-1176-4587-ba97-f21adbc84f9e req-8c505fac-bd5f-4468-b9c6-72cfac098620 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:20.261201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-6751d0d5-1176-4587-ba97-f21adbc84f9e req-8c505fac-bd5f-4468-b9c6-72cfac098620 service nova] Creating event network-changed:daea8158-0875-402f-9603-ddb321067a70 for instance 3625263b-e16f-4c5c-a20a-591dca9ca140 on hv-cinder-82002 Sep 08 13:59:20.266763 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-6751d0d5-1176-4587-ba97-f21adbc84f9e req-8c505fac-bd5f-4468-b9c6-72cfac098620 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037789 Sep 08 13:59:20.267455 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 456/912] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:21.073438 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-58a1abe8-89f0-4d46-9650-0c92c0c9afe6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:21.075043 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-58a1abe8-89f0-4d46-9650-0c92c0c9afe6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:21.083561 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58a1abe8-89f0-4d46-9650-0c92c0c9afe6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:21.084348 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58a1abe8-89f0-4d46-9650-0c92c0c9afe6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:21.085057 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58a1abe8-89f0-4d46-9650-0c92c0c9afe6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:21.086335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58a1abe8-89f0-4d46-9650-0c92c0c9afe6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:21.086857 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58a1abe8-89f0-4d46-9650-0c92c0c9afe6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:21.087533 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-58a1abe8-89f0-4d46-9650-0c92c0c9afe6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:21.284324 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-58a1abe8-89f0-4d46-9650-0c92c0c9afe6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:21.293147 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-58a1abe8-89f0-4d46-9650-0c92c0c9afe6 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1367 microversion: 2.1 time: 0.230015 Sep 08 13:59:21.305801 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 457/913] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:21 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:22.318845 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e39348ac-17a6-47b5-9b86-c04619825a0d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:22.319675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e39348ac-17a6-47b5-9b86-c04619825a0d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:22.325727 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e39348ac-17a6-47b5-9b86-c04619825a0d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:22.326249 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e39348ac-17a6-47b5-9b86-c04619825a0d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:22.326681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e39348ac-17a6-47b5-9b86-c04619825a0d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:22.327377 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e39348ac-17a6-47b5-9b86-c04619825a0d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:22.327837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e39348ac-17a6-47b5-9b86-c04619825a0d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:22.328263 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e39348ac-17a6-47b5-9b86-c04619825a0d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:22.464051 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e39348ac-17a6-47b5-9b86-c04619825a0d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:22.472748 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e39348ac-17a6-47b5-9b86-c04619825a0d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1557 microversion: 2.1 time: 0.158762 Sep 08 13:59:22.473433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 457/914] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:22 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:22.495824 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6bb4584e-5b3e-48c1-84b5-0f8edc97c80f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:22.496481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6bb4584e-5b3e-48c1-84b5-0f8edc97c80f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:22.503246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb4584e-5b3e-48c1-84b5-0f8edc97c80f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:22.503815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb4584e-5b3e-48c1-84b5-0f8edc97c80f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:22.504328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb4584e-5b3e-48c1-84b5-0f8edc97c80f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:22.505107 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb4584e-5b3e-48c1-84b5-0f8edc97c80f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:22.505566 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb4584e-5b3e-48c1-84b5-0f8edc97c80f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:22.506206 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6bb4584e-5b3e-48c1-84b5-0f8edc97c80f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:22.646957 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6bb4584e-5b3e-48c1-84b5-0f8edc97c80f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155150 Sep 08 13:59:22.655621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 458/915] 10.222.0.55 () {58 vars in 1275 bytes} [Thu Sep 8 13:59:22 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:23.685513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bc9292bd-8a6f-4220-a1af-b3110997a4de tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] Calling method '.version_select at 0x7f5be436a160>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:23.735865 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bc9292bd-8a6f-4220-a1af-b3110997a4de tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/36329e2b-a6b5-4516-9b40-712790ff0f16" status: 200 len: 351 microversion: 2.1 time: 0.054137 Sep 08 13:59:23.736443 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 458/916] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:59:23 2022] GET /compute/v2.1/os-volumes/36329e2b-a6b5-4516-9b40-712790ff0f16 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:23.801602 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-3a1e21a5-23b1-454b-a751-200eb3546365 req-d14c8229-5de0-49e2-add9-85eaa072db1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5ce5ad-7f55-4482-bff3-96eb19463f07", "tag": "e14cb466-443e-415d-b932-45c6f7a15d37"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:23.813000 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3a1e21a5-23b1-454b-a751-200eb3546365 req-d14c8229-5de0-49e2-add9-85eaa072db1e service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:23.813806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3a1e21a5-23b1-454b-a751-200eb3546365 req-d14c8229-5de0-49e2-add9-85eaa072db1e service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:23.814481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-3a1e21a5-23b1-454b-a751-200eb3546365 req-d14c8229-5de0-49e2-add9-85eaa072db1e service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:23.827203 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-3a1e21a5-23b1-454b-a751-200eb3546365 req-d14c8229-5de0-49e2-add9-85eaa072db1e service nova] Creating event network-changed:e14cb466-443e-415d-b932-45c6f7a15d37 for instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 on hv-cinder-82002 Sep 08 13:59:23.832545 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-3a1e21a5-23b1-454b-a751-200eb3546365 req-d14c8229-5de0-49e2-add9-85eaa072db1e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036099 Sep 08 13:59:23.833342 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 459/917] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 13:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:59:25.123747 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f616ea72-7675-46a6-b753-6c3d132cd28b tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] Calling method '.version_select at 0x7f5be43dbaf0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:25.173223 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f616ea72-7675-46a6-b753-6c3d132cd28b tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/e752f81f-02a8-4bd8-bb7f-d0140c6b8ceb" status: 200 len: 350 microversion: 2.1 time: 0.054497 Sep 08 13:59:25.173827 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 459/918] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:59:25 2022] GET /compute/v2.1/os-volumes/e752f81f-02a8-4bd8-bb7f-d0140c6b8ceb => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:26.518126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ab554443-1a54-4b5f-95f2-5775bc0bf9a9 tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] Calling method '.version_select at 0x7f5be4474430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:26.565671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ab554443-1a54-4b5f-95f2-5775bc0bf9a9 tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5df1bd67-d674-433a-8774-9481d7f51914" status: 200 len: 351 microversion: 2.1 time: 0.052561 Sep 08 13:59:26.566260 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 460/919] 10.222.0.55 () {58 vars in 1245 bytes} [Thu Sep 8 13:59:26 2022] GET /compute/v2.1/os-volumes/5df1bd67-d674-433a-8774-9481d7f51914 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:26.579631 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0e23f6fc-b536-41be-b6c4-218e9a5591c0 tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] Calling method '.version_select at 0x7f5be42f8280>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:26.662093 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0e23f6fc-b536-41be-b6c4-218e9a5591c0 tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086563 Sep 08 13:59:26.662744 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 460/920] 10.222.0.55 () {58 vars in 1134 bytes} [Thu Sep 8 13:59:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:26.676850 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a90274e-d142-4a9c-b4c8-906ce390603c tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] Calling method '.version_select at 0x7f5be442b790>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:26.758141 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a90274e-d142-4a9c-b4c8-906ce390603c tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084936 Sep 08 13:59:26.758709 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 461/921] 10.222.0.55 () {58 vars in 1149 bytes} [Thu Sep 8 13:59:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:26.773035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0d94613a-0e19-4419-96b3-613fec92b75e tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] Calling method '.version_select at 0x7f5be43dbaf0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:26.854280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0d94613a-0e19-4419-96b3-613fec92b75e tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084844 Sep 08 13:59:26.854851 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 461/922] 10.222.0.55 () {58 vars in 1134 bytes} [Thu Sep 8 13:59:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:26.868437 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ffbe510-8153-4477-b517-ec6f8e6b5b1d tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] Calling method '.version_select at 0x7f5be44dcdc0>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:26.952481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ffbe510-8153-4477-b517-ec6f8e6b5b1d tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087611 Sep 08 13:59:26.953143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 462/923] 10.222.0.55 () {58 vars in 1167 bytes} [Thu Sep 8 13:59:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:26.966798 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c3663173-92e0-46c9-a810-77b33e12200c tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] Calling method '.version_select at 0x7f5be42f88b0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:27.047996 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c3663173-92e0-46c9-a810-77b33e12200c tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085163 Sep 08 13:59:27.048569 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 462/924] 10.222.0.55 () {58 vars in 1170 bytes} [Thu Sep 8 13:59:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:27.062762 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-277ab452-b00c-4f84-929d-b4856cac2540 tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] Calling method '.version_select at 0x7f5be4459430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:27.145573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-277ab452-b00c-4f84-929d-b4856cac2540 tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087037 Sep 08 13:59:27.146197 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 463/925] 10.222.0.55 () {58 vars in 1155 bytes} [Thu Sep 8 13:59:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:27.159543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6ab25736-e9d7-466a-a764-7845146411b3 tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] Calling method '.version_select at 0x7f5be4303f70>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:27.247883 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6ab25736-e9d7-466a-a764-7845146411b3 tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092059 Sep 08 13:59:27.248464 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 463/926] 10.222.0.55 () {58 vars in 1188 bytes} [Thu Sep 8 13:59:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:27.262464 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-088ae6b5-bac9-4442-8e3f-070c6abecb6c tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] Calling method '.version_select at 0x7f5be449b280>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:27.341559 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-088ae6b5-bac9-4442-8e3f-070c6abecb6c tempest-VolumesTestJSON-1223090479 tempest-VolumesTestJSON-1223090479-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083562 Sep 08 13:59:27.342154 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 464/927] 10.222.0.55 () {58 vars in 1155 bytes} [Thu Sep 8 13:59:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:59.319355 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5dc95476-ee13-4078-bd71-526e496290b6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:59.320117 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5dc95476-ee13-4078-bd71-526e496290b6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:59.324520 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=24 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:59.325216 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=64 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:59.331462 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dc95476-ee13-4078-bd71-526e496290b6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:59.332035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dc95476-ee13-4078-bd71-526e496290b6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:59.332471 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dc95476-ee13-4078-bd71-526e496290b6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:59.333182 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dc95476-ee13-4078-bd71-526e496290b6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:59.333633 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dc95476-ee13-4078-bd71-526e496290b6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:59.334378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5dc95476-ee13-4078-bd71-526e496290b6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:59.358380 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5dc95476-ee13-4078-bd71-526e496290b6 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/ips" status: 200 len: 146 microversion: 2.1 time: 0.043956 Sep 08 13:59:59.358959 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 464/928] 10.222.0.55 () {58 vars in 1248 bytes} [Thu Sep 8 13:59:59 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:00.687748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:00.688496 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=34 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:00.693107 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3aff5564-5f90-4888-9d83-dcfe3fcd76e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "475a10a2-a359-4371-8f7c-e42432a79cf9"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:00.695529 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3aff5564-5f90-4888-9d83-dcfe3fcd76e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:00.703893 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aff5564-5f90-4888-9d83-dcfe3fcd76e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:00.704375 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aff5564-5f90-4888-9d83-dcfe3fcd76e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:00.704808 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aff5564-5f90-4888-9d83-dcfe3fcd76e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:00.705500 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aff5564-5f90-4888-9d83-dcfe3fcd76e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:00.705984 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aff5564-5f90-4888-9d83-dcfe3fcd76e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:00.706406 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3aff5564-5f90-4888-9d83-dcfe3fcd76e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:00.974680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3aff5564-5f90-4888-9d83-dcfe3fcd76e5 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "POST /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288191 Sep 08 14:00:00.975280 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 465/929] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 14:00:00 2022] POST /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:07.380066 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-85d88fc6-bc02-46da-8e05-c520eea5c329 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:07.380749 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-85d88fc6-bc02-46da-8e05-c520eea5c329 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:07.387375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85d88fc6-bc02-46da-8e05-c520eea5c329 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:07.387864 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85d88fc6-bc02-46da-8e05-c520eea5c329 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:07.388301 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85d88fc6-bc02-46da-8e05-c520eea5c329 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:07.388997 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85d88fc6-bc02-46da-8e05-c520eea5c329 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:07.389456 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85d88fc6-bc02-46da-8e05-c520eea5c329 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:07.389916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-85d88fc6-bc02-46da-8e05-c520eea5c329 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:07.413861 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-85d88fc6-bc02-46da-8e05-c520eea5c329 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/ips" status: 200 len: 152 microversion: 2.20 time: 0.037744 Sep 08 14:00:07.414470 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 465/930] 10.222.0.55 () {60 vars in 1289 bytes} [Thu Sep 8 14:00:07 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:00:08.520030 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2840bf24-7d19-42bf-95f0-98ac7b1f9aff tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:08.522301 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2840bf24-7d19-42bf-95f0-98ac7b1f9aff tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:08.529020 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2840bf24-7d19-42bf-95f0-98ac7b1f9aff tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:08.529510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2840bf24-7d19-42bf-95f0-98ac7b1f9aff tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:08.530111 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2840bf24-7d19-42bf-95f0-98ac7b1f9aff tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:08.530812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2840bf24-7d19-42bf-95f0-98ac7b1f9aff tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:08.531342 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2840bf24-7d19-42bf-95f0-98ac7b1f9aff tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:08.531914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2840bf24-7d19-42bf-95f0-98ac7b1f9aff tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:08.562394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2840bf24-7d19-42bf-95f0-98ac7b1f9aff tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047069 Sep 08 14:00:08.562946 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 466/931] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 14:00:08 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:08.574453 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f8a3a253-af6b-4a3c-bca8-17ea1b35a05d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:08.574976 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f8a3a253-af6b-4a3c-bca8-17ea1b35a05d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:08.581314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8a3a253-af6b-4a3c-bca8-17ea1b35a05d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:08.581840 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8a3a253-af6b-4a3c-bca8-17ea1b35a05d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:08.582285 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8a3a253-af6b-4a3c-bca8-17ea1b35a05d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:08.582999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8a3a253-af6b-4a3c-bca8-17ea1b35a05d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:08.583452 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8a3a253-af6b-4a3c-bca8-17ea1b35a05d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:08.583881 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f8a3a253-af6b-4a3c-bca8-17ea1b35a05d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:08.613177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f8a3a253-af6b-4a3c-bca8-17ea1b35a05d tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments/475a10a2-a359-4371-8f7c-e42432a79cf9" status: 200 len: 194 microversion: 2.1 time: 0.043259 Sep 08 14:00:08.613784 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 466/932] 10.222.0.55 () {58 vars in 1413 bytes} [Thu Sep 8 14:00:08 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments/475a10a2-a359-4371-8f7c-e42432a79cf9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:09.971502 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2902e859-1490-4bd7-8a0f-ce18e14e670c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "384a320c-c683-4c31-b5b6-39c3ed756bc4"}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:09.973852 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2902e859-1490-4bd7-8a0f-ce18e14e670c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:09.980676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2902e859-1490-4bd7-8a0f-ce18e14e670c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:09.981159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2902e859-1490-4bd7-8a0f-ce18e14e670c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:09.981593 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2902e859-1490-4bd7-8a0f-ce18e14e670c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:09.982322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2902e859-1490-4bd7-8a0f-ce18e14e670c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:09.982780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2902e859-1490-4bd7-8a0f-ce18e14e670c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:09.983198 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2902e859-1490-4bd7-8a0f-ce18e14e670c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.261676 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ce90c09e-e21b-46ab-aa3c-8b65d273bfc7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:10.262243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ce90c09e-e21b-46ab-aa3c-8b65d273bfc7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:10.269616 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce90c09e-e21b-46ab-aa3c-8b65d273bfc7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.270207 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce90c09e-e21b-46ab-aa3c-8b65d273bfc7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.270647 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce90c09e-e21b-46ab-aa3c-8b65d273bfc7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.271403 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce90c09e-e21b-46ab-aa3c-8b65d273bfc7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.271904 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce90c09e-e21b-46ab-aa3c-8b65d273bfc7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.272382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ce90c09e-e21b-46ab-aa3c-8b65d273bfc7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.298594 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-ce90c09e-e21b-46ab-aa3c-8b65d273bfc7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lazy-loading 'flavor' on Instance uuid 3625263b-e16f-4c5c-a20a-591dca9ca140 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:00:10.303261 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2902e859-1490-4bd7-8a0f-ce18e14e670c tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "POST /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335492 Sep 08 14:00:10.303948 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 467/933] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 14:00:09 2022] POST /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:10.499362 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ce90c09e-e21b-46ab-aa3c-8b65d273bfc7 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "POST /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/action" status: 202 len: 0 microversion: 2.20 time: 0.242958 Sep 08 14:00:10.499962 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 467/934] 10.222.0.55 () {62 vars in 1319 bytes} [Thu Sep 8 14:00:10 2022] POST /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:00:10.509318 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:10.510286 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:10.517248 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.517724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.518182 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.518872 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.519314 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.519724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.660740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:10.668758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:10.670204 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:10.671370 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f3c2b5c3-cfe2-4984-af0d-92870fd3f75d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.167037 Sep 08 14:00:10.671923 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 468/935] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:10 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:10.822468 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-db7f1a87-bb35-4fcb-bcd8-3d5bd92fc3d4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:10.823584 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-db7f1a87-bb35-4fcb-bcd8-3d5bd92fc3d4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:10.829773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db7f1a87-bb35-4fcb-bcd8-3d5bd92fc3d4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.830254 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db7f1a87-bb35-4fcb-bcd8-3d5bd92fc3d4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.830684 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db7f1a87-bb35-4fcb-bcd8-3d5bd92fc3d4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.831359 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db7f1a87-bb35-4fcb-bcd8-3d5bd92fc3d4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.831800 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db7f1a87-bb35-4fcb-bcd8-3d5bd92fc3d4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.832219 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-db7f1a87-bb35-4fcb-bcd8-3d5bd92fc3d4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.857195 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-db7f1a87-bb35-4fcb-bcd8-3d5bd92fc3d4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/ips" status: 200 len: 149 microversion: 2.1 time: 0.039182 Sep 08 14:00:10.857775 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 468/936] 10.222.0.55 () {58 vars in 1248 bytes} [Thu Sep 8 14:00:10 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:11.697157 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:11.697707 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:11.704698 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:11.705186 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:11.705621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:11.706336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:11.706789 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:11.707210 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:11.846662 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:11.854993 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:11.856421 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:11.857572 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d81f01d9-149a-47b8-a3b2-f7393c3a0abe tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.164495 Sep 08 14:00:11.858174 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 469/937] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:11 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:12.220393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c594aaa5-06c8-4d4a-b29b-afd983c77ef4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b78892a4-c876-4972-a698-4fd2ad532df9"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:12.222790 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c594aaa5-06c8-4d4a-b29b-afd983c77ef4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:12.230007 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c594aaa5-06c8-4d4a-b29b-afd983c77ef4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:12.230411 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c594aaa5-06c8-4d4a-b29b-afd983c77ef4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:12.230849 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c594aaa5-06c8-4d4a-b29b-afd983c77ef4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:12.231567 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c594aaa5-06c8-4d4a-b29b-afd983c77ef4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:12.232016 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c594aaa5-06c8-4d4a-b29b-afd983c77ef4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:12.232437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c594aaa5-06c8-4d4a-b29b-afd983c77ef4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:12.546963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c594aaa5-06c8-4d4a-b29b-afd983c77ef4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "POST /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330221 Sep 08 14:00:12.547594 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 469/938] 10.222.0.55 () {60 vars in 1323 bytes} [Thu Sep 8 14:00:12 2022] POST /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:12.882680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:12.883291 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:12.889826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:12.890313 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:12.890747 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:12.891442 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:12.891899 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:12.892323 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:13.024317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:13.032854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:13.034339 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:13.035593 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-507740c6-17d6-40cf-a43a-7ee468446764 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.156876 Sep 08 14:00:13.036172 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 470/939] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:12 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:14.064230 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:14.064932 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:14.072088 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:14.072585 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:14.073708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:14.075628 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:14.077056 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:14.079139 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:14.213333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:14.222464 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:14.224081 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:14.225139 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0c4fd668-caa5-4608-97ca-54dc85dcb8ea tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.165958 Sep 08 14:00:14.225690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 470/940] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:14 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:15.250547 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:15.251102 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:15.261384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:15.261918 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:15.262357 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:15.263086 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:15.263535 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:15.263957 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:15.405582 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:15.413707 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:15.415165 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:15.416315 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-755e55f7-6ceb-4e14-aa84-524597cc3b3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.169847 Sep 08 14:00:15.416948 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 471/941] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:15 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:16.440432 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:16.441041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:16.448438 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:16.448933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:16.449372 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:16.450129 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:16.450582 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:16.451011 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:16.582835 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:16.592231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:16.593930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:16.595163 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c4c3fb8e-d851-48f3-bcb0-ddde13a2c706 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.158715 Sep 08 14:00:16.596049 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 471/942] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:16 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:17.621080 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:17.621704 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:17.628201 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:17.628684 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:17.629120 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:17.629838 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:17.630296 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:17.630727 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:17.771457 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:17.779956 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:17.781399 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:17.782577 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-6eab6761-983d-4689-b022-c68c902b4ae4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.166096 Sep 08 14:00:17.783128 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 472/943] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:17 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:18.808748 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:18.809388 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:18.815902 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:18.816385 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:18.816823 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:18.817615 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:18.818024 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:18.818448 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:18.912127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e585dc2a-ae0e-43fc-bfe0-00e4fff5f8ca tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:18.915125 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e585dc2a-ae0e-43fc-bfe0-00e4fff5f8ca tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:18.935202 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e585dc2a-ae0e-43fc-bfe0-00e4fff5f8ca tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:18.935807 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e585dc2a-ae0e-43fc-bfe0-00e4fff5f8ca tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:18.936263 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e585dc2a-ae0e-43fc-bfe0-00e4fff5f8ca tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:18.937045 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e585dc2a-ae0e-43fc-bfe0-00e4fff5f8ca tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:18.937878 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e585dc2a-ae0e-43fc-bfe0-00e4fff5f8ca tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:18.938475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e585dc2a-ae0e-43fc-bfe0-00e4fff5f8ca tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:18.981806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e585dc2a-ae0e-43fc-bfe0-00e4fff5f8ca tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.074168 Sep 08 14:00:18.982250 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 473/944] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 14:00:18 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:18.984851 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:18.994081 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:18.996342 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:18.997569 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8e12463d-56ed-410d-b0ff-f869db003566 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.193169 Sep 08 14:00:18.998237 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 472/945] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:18 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:19.128346 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-906198c5-06cc-49fa-89bd-267913c56550 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:19.128840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-906198c5-06cc-49fa-89bd-267913c56550 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:19.134949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-906198c5-06cc-49fa-89bd-267913c56550 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:19.135439 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-906198c5-06cc-49fa-89bd-267913c56550 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:19.135877 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-906198c5-06cc-49fa-89bd-267913c56550 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:19.136581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-906198c5-06cc-49fa-89bd-267913c56550 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:19.137036 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-906198c5-06cc-49fa-89bd-267913c56550 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:19.137459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-906198c5-06cc-49fa-89bd-267913c56550 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:19.168123 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-906198c5-06cc-49fa-89bd-267913c56550 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments/475a10a2-a359-4371-8f7c-e42432a79cf9" status: 200 len: 194 microversion: 2.1 time: 0.043593 Sep 08 14:00:19.168640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 474/946] 10.222.0.55 () {58 vars in 1413 bytes} [Thu Sep 8 14:00:19 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments/475a10a2-a359-4371-8f7c-e42432a79cf9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:19.179675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b19f9955-baea-4ac3-bf2f-bb7aa5ab9e51 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:19.180162 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b19f9955-baea-4ac3-bf2f-bb7aa5ab9e51 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:19.186640 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b19f9955-baea-4ac3-bf2f-bb7aa5ab9e51 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:19.187112 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b19f9955-baea-4ac3-bf2f-bb7aa5ab9e51 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:19.187626 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b19f9955-baea-4ac3-bf2f-bb7aa5ab9e51 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:19.188380 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b19f9955-baea-4ac3-bf2f-bb7aa5ab9e51 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:19.188828 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b19f9955-baea-4ac3-bf2f-bb7aa5ab9e51 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:19.189268 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b19f9955-baea-4ac3-bf2f-bb7aa5ab9e51 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:19.268806 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-b19f9955-baea-4ac3-bf2f-bb7aa5ab9e51 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lazy-loading 'services' on Instance uuid 9e839a72-e12e-4617-88c9-ed12f748c399 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:00:19.340362 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b19f9955-baea-4ac3-bf2f-bb7aa5ab9e51 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments/475a10a2-a359-4371-8f7c-e42432a79cf9" status: 202 len: 0 microversion: 2.1 time: 0.164800 Sep 08 14:00:19.340951 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 473/947] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 14:00:19 2022] DELETE /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments/475a10a2-a359-4371-8f7c-e42432a79cf9 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:00:20.024103 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:20.024733 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:20.031076 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:20.031544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:20.031993 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:20.032677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:20.033116 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:20.033527 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:20.168970 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:20.177395 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:20.178938 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:20.180095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-02f60ac2-b258-4aab-ac62-93a2d40b5e46 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.160103 Sep 08 14:00:20.180657 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 475/948] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:20 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:21.210841 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:21.211452 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:21.217924 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:21.218409 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:21.218844 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:21.219544 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:21.219995 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:21.220489 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:21.350980 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:21.359445 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:21.360886 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:21.362072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-65e60d4e-3ce7-4b29-974e-0d477be7b40b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.156277 Sep 08 14:00:21.362634 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 474/949] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:21 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:22.388299 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:22.388818 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:22.395552 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:22.396067 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:22.396502 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:22.397196 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:22.397649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:22.398109 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:22.526603 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:22.534781 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:22.536338 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:22.537525 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3c30d973-fee6-48ac-adcb-aa7e1f3c5c15 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.153767 Sep 08 14:00:22.538115 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 476/950] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:22 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:23.563785 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:23.564324 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:23.570757 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:23.571239 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:23.571677 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:23.572375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:23.573437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:23.573894 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:23.707553 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:23.715929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:23.717348 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:23.718509 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-827efb07-5de1-4fcc-bb0d-1fcce8f466ac tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.158735 Sep 08 14:00:23.719066 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 475/951] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:23 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:24.744001 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:24.745088 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:24.751423 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:24.751896 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:24.752317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:24.753098 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:24.753617 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:24.754067 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:24.889844 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:24.899179 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:24.899510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:24.900664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c30bd6c9-90cd-47d7-afbb-3ce42ba53e3f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.160624 Sep 08 14:00:24.910418 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 477/952] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:24 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:25.509202 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2acda43c-b676-482a-9784-44c6abd134b9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:25.509749 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2acda43c-b676-482a-9784-44c6abd134b9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:25.516166 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2acda43c-b676-482a-9784-44c6abd134b9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.516648 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2acda43c-b676-482a-9784-44c6abd134b9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.517086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2acda43c-b676-482a-9784-44c6abd134b9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:25.517804 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2acda43c-b676-482a-9784-44c6abd134b9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.518264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2acda43c-b676-482a-9784-44c6abd134b9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.518688 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2acda43c-b676-482a-9784-44c6abd134b9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:25.597780 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-2acda43c-b676-482a-9784-44c6abd134b9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lazy-loading 'services' on Instance uuid 4d5ce5ad-7f55-4482-bff3-96eb19463f07 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:00:25.656650 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:25.668201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2acda43c-b676-482a-9784-44c6abd134b9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-volume_attachments/b78892a4-c876-4972-a698-4fd2ad532df9" status: 202 len: 0 microversion: 2.1 time: 0.162738 Sep 08 14:00:25.668783 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 476/953] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 14:00:25 2022] DELETE /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-volume_attachments/b78892a4-c876-4972-a698-4fd2ad532df9 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:00:25.677083 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a602317d-1636-4bd2-a729-bd89d0f36ea9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:25.679332 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a602317d-1636-4bd2-a729-bd89d0f36ea9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:25.685514 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a602317d-1636-4bd2-a729-bd89d0f36ea9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.686054 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a602317d-1636-4bd2-a729-bd89d0f36ea9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.686481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a602317d-1636-4bd2-a729-bd89d0f36ea9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:25.687164 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a602317d-1636-4bd2-a729-bd89d0f36ea9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.687606 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a602317d-1636-4bd2-a729-bd89d0f36ea9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.688017 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a602317d-1636-4bd2-a729-bd89d0f36ea9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:25.712827 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:25.719325 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a602317d-1636-4bd2-a729-bd89d0f36ea9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046226 Sep 08 14:00:25.719981 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 478/954] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 14:00:25 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:25.927137 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:25.927837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:25.934407 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.934891 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.935337 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:25.936036 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:25.936535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:25.936964 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.077442 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:26.085868 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:26.087323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:26.089205 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3ea20dc4-2e6d-45d6-a2ad-84684f4afcb1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.166290 Sep 08 14:00:26.090029 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 477/955] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:25 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:00:26.732657 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-eb9a3f98-ec62-4017-be8e-93e8d4d8fa2f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:26.734866 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-eb9a3f98-ec62-4017-be8e-93e8d4d8fa2f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:26.742367 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9a3f98-ec62-4017-be8e-93e8d4d8fa2f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.742845 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9a3f98-ec62-4017-be8e-93e8d4d8fa2f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.743275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9a3f98-ec62-4017-be8e-93e8d4d8fa2f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.743966 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9a3f98-ec62-4017-be8e-93e8d4d8fa2f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.744457 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9a3f98-ec62-4017-be8e-93e8d4d8fa2f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.745405 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-eb9a3f98-ec62-4017-be8e-93e8d4d8fa2f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.778481 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-eb9a3f98-ec62-4017-be8e-93e8d4d8fa2f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049956 Sep 08 14:00:26.778782 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 479/956] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 14:00:26 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:26.812544 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-08f1883b-1e90-42ad-8084-dba96790e585 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:26.813036 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-08f1883b-1e90-42ad-8084-dba96790e585 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:26.819389 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f1883b-1e90-42ad-8084-dba96790e585 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.819869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f1883b-1e90-42ad-8084-dba96790e585 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.820299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f1883b-1e90-42ad-8084-dba96790e585 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.820984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f1883b-1e90-42ad-8084-dba96790e585 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.821436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f1883b-1e90-42ad-8084-dba96790e585 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.821885 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-08f1883b-1e90-42ad-8084-dba96790e585 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.850642 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-08f1883b-1e90-42ad-8084-dba96790e585 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments/384a320c-c683-4c31-b5b6-39c3ed756bc4" status: 200 len: 194 microversion: 2.1 time: 0.041955 Sep 08 14:00:26.851216 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 478/957] 10.222.0.55 () {58 vars in 1413 bytes} [Thu Sep 8 14:00:26 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments/384a320c-c683-4c31-b5b6-39c3ed756bc4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:26.862520 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b650708b-6428-4465-b56f-1320b75fb744 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:26.863040 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b650708b-6428-4465-b56f-1320b75fb744 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:26.868986 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b650708b-6428-4465-b56f-1320b75fb744 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.869503 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b650708b-6428-4465-b56f-1320b75fb744 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.870631 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b650708b-6428-4465-b56f-1320b75fb744 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.871329 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b650708b-6428-4465-b56f-1320b75fb744 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:26.871768 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b650708b-6428-4465-b56f-1320b75fb744 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:26.872274 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b650708b-6428-4465-b56f-1320b75fb744 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:26.971440 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-b650708b-6428-4465-b56f-1320b75fb744 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lazy-loading 'services' on Instance uuid 9e839a72-e12e-4617-88c9-ed12f748c399 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:00:27.114646 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:27.115262 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:27.121241 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:27.121721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:27.122185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:27.122873 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:27.123326 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:27.123738 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:27.246041 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b650708b-6428-4465-b56f-1320b75fb744 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments/384a320c-c683-4c31-b5b6-39c3ed756bc4" status: 202 len: 0 microversion: 2.1 time: 0.386942 Sep 08 14:00:27.247727 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 480/958] 10.222.0.55 () {58 vars in 1416 bytes} [Thu Sep 8 14:00:26 2022] DELETE /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments/384a320c-c683-4c31-b5b6-39c3ed756bc4 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:00:27.316043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:27.325069 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:27.326540 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:27.327701 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1fabcec4-e516-4174-ac03-ad62ab71487d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1746 microversion: 2.20 time: 0.216914 Sep 08 14:00:27.328800 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 479/959] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:27 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1746 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:00:27.792259 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a0ddf041-7f15-47f6-9ecd-a716032e3f20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:27.794652 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a0ddf041-7f15-47f6-9ecd-a716032e3f20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:27.800817 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ddf041-7f15-47f6-9ecd-a716032e3f20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:27.801294 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ddf041-7f15-47f6-9ecd-a716032e3f20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:27.801724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ddf041-7f15-47f6-9ecd-a716032e3f20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:27.802435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ddf041-7f15-47f6-9ecd-a716032e3f20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:27.802884 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ddf041-7f15-47f6-9ecd-a716032e3f20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:27.803305 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a0ddf041-7f15-47f6-9ecd-a716032e3f20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:27.831107 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a0ddf041-7f15-47f6-9ecd-a716032e3f20 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044237 Sep 08 14:00:27.831656 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 481/960] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 14:00:27 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:00:27.899295 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1ee62104-a0d3-4ae2-9dd1-ad92d7dba502 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:27.899863 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ee62104-a0d3-4ae2-9dd1-ad92d7dba502 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:27.906824 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee62104-a0d3-4ae2-9dd1-ad92d7dba502 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:27.907395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee62104-a0d3-4ae2-9dd1-ad92d7dba502 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:27.907894 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee62104-a0d3-4ae2-9dd1-ad92d7dba502 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:27.908615 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee62104-a0d3-4ae2-9dd1-ad92d7dba502 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:27.909048 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee62104-a0d3-4ae2-9dd1-ad92d7dba502 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:27.909467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1ee62104-a0d3-4ae2-9dd1-ad92d7dba502 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:27.934855 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1ee62104-a0d3-4ae2-9dd1-ad92d7dba502 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:00:28.008844 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1ee62104-a0d3-4ae2-9dd1-ad92d7dba502 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 204 len: 0 microversion: 2.1 time: 0.113068 Sep 08 14:00:28.009369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 480/961] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:00:27 2022] DELETE /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:00:28.017589 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-dff136d6-0578-42c0-b92f-cd702bc9eb4d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:28.018225 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-dff136d6-0578-42c0-b92f-cd702bc9eb4d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:28.024050 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff136d6-0578-42c0-b92f-cd702bc9eb4d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.024519 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff136d6-0578-42c0-b92f-cd702bc9eb4d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.024944 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff136d6-0578-42c0-b92f-cd702bc9eb4d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.026173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff136d6-0578-42c0-b92f-cd702bc9eb4d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.026596 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff136d6-0578-42c0-b92f-cd702bc9eb4d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.027003 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-dff136d6-0578-42c0-b92f-cd702bc9eb4d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.182586 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-dff136d6-0578-42c0-b92f-cd702bc9eb4d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:28.190198 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-dff136d6-0578-42c0-b92f-cd702bc9eb4d tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1681 microversion: 2.1 time: 0.176349 Sep 08 14:00:28.190761 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 482/962] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:28 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:28.355943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:28.356641 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:28.362592 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.363092 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.363503 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.364196 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:28.364647 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:28.365064 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:28.497497 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:28.505499 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:28.506963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:28.508112 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-eb5b1f5c-2491-4dbd-a707-02f8dfa83793 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1746 microversion: 2.20 time: 0.158274 Sep 08 14:00:28.508672 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 481/963] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:28 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:29.212565 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9efce15b-ad99-4751-8752-ea5dcab960b1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:29.213695 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9efce15b-ad99-4751-8752-ea5dcab960b1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:29.220445 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9efce15b-ad99-4751-8752-ea5dcab960b1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.220928 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9efce15b-ad99-4751-8752-ea5dcab960b1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.221367 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9efce15b-ad99-4751-8752-ea5dcab960b1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:29.222079 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9efce15b-ad99-4751-8752-ea5dcab960b1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.222537 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9efce15b-ad99-4751-8752-ea5dcab960b1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.222958 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9efce15b-ad99-4751-8752-ea5dcab960b1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:29.350151 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9efce15b-ad99-4751-8752-ea5dcab960b1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:29.357920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9efce15b-ad99-4751-8752-ea5dcab960b1 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1681 microversion: 2.1 time: 0.149307 Sep 08 14:00:29.358488 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 483/964] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:29 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:29.533642 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:29.534231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:29.536562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:29.543242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.543768 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.544256 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:29.544963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:29.545419 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:29.545874 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:29.678861 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:29.687389 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:29.688824 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:29.689972 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e4d76eeb-2464-4914-b2a8-edd82da2040c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1746 microversion: 2.20 time: 0.160265 Sep 08 14:00:29.690521 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 482/965] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:29 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:30.380817 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0eda5b63-7c7c-43d0-92c7-0fb2a2c41c29 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:30.381428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0eda5b63-7c7c-43d0-92c7-0fb2a2c41c29 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:30.388343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eda5b63-7c7c-43d0-92c7-0fb2a2c41c29 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:30.388819 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eda5b63-7c7c-43d0-92c7-0fb2a2c41c29 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:30.389248 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eda5b63-7c7c-43d0-92c7-0fb2a2c41c29 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:30.390028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eda5b63-7c7c-43d0-92c7-0fb2a2c41c29 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:30.390474 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eda5b63-7c7c-43d0-92c7-0fb2a2c41c29 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:30.390890 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0eda5b63-7c7c-43d0-92c7-0fb2a2c41c29 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:30.521070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0eda5b63-7c7c-43d0-92c7-0fb2a2c41c29 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:30.529260 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0eda5b63-7c7c-43d0-92c7-0fb2a2c41c29 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1681 microversion: 2.1 time: 0.152268 Sep 08 14:00:30.529832 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 484/966] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:30 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:30.715690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:30.716245 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:30.722620 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:30.723102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:30.723532 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:30.724227 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:30.724675 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:30.725096 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:30.853933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:30.861893 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:30.863318 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:30.864459 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-33ca9c53-f12c-4671-a786-7f71042f75b0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1746 microversion: 2.20 time: 0.153548 Sep 08 14:00:30.865017 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 483/967] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:30 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:31.553793 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-09594d76-39ba-40e1-bac1-28b8120d61e4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:31.554412 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-09594d76-39ba-40e1-bac1-28b8120d61e4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:31.556862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=41 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:31.562759 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09594d76-39ba-40e1-bac1-28b8120d61e4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:31.563372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09594d76-39ba-40e1-bac1-28b8120d61e4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:31.563802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09594d76-39ba-40e1-bac1-28b8120d61e4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:31.564494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09594d76-39ba-40e1-bac1-28b8120d61e4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:31.564939 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09594d76-39ba-40e1-bac1-28b8120d61e4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:31.565352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-09594d76-39ba-40e1-bac1-28b8120d61e4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:31.697159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-09594d76-39ba-40e1-bac1-28b8120d61e4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:31.704856 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-09594d76-39ba-40e1-bac1-28b8120d61e4 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1681 microversion: 2.1 time: 0.154989 Sep 08 14:00:31.705422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 485/968] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:31 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:31.891794 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:31.892403 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:31.898967 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:31.899388 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:31.899819 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:31.900579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:31.901538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:31.901988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:32.031252 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:32.039273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:32.040707 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:32.041888 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0aefc418-4950-47f8-92a9-84d86c996a68 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1746 microversion: 2.20 time: 0.153887 Sep 08 14:00:32.042485 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 484/969] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:31 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:32.729077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-83e278cf-0480-4fcd-be4f-c48774ac478e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:32.729677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-83e278cf-0480-4fcd-be4f-c48774ac478e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:32.736152 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e278cf-0480-4fcd-be4f-c48774ac478e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:32.736632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e278cf-0480-4fcd-be4f-c48774ac478e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:32.737061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e278cf-0480-4fcd-be4f-c48774ac478e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:32.737768 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e278cf-0480-4fcd-be4f-c48774ac478e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:32.738225 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e278cf-0480-4fcd-be4f-c48774ac478e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:32.738645 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-83e278cf-0480-4fcd-be4f-c48774ac478e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:32.872776 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-83e278cf-0480-4fcd-be4f-c48774ac478e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:32.880573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-83e278cf-0480-4fcd-be4f-c48774ac478e tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1681 microversion: 2.1 time: 0.155906 Sep 08 14:00:32.881135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 486/970] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:32 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:33.068952 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:33.070174 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:33.078322 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.078807 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.079242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.079938 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.080427 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.080851 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.220140 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-718ca003-6d37-4cf0-9883-b0d23a71226b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:33.223749 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-718ca003-6d37-4cf0-9883-b0d23a71226b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:33.227344 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:33.231569 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-718ca003-6d37-4cf0-9883-b0d23a71226b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.232317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-718ca003-6d37-4cf0-9883-b0d23a71226b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.232970 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-718ca003-6d37-4cf0-9883-b0d23a71226b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.233778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-718ca003-6d37-4cf0-9883-b0d23a71226b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.234451 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-718ca003-6d37-4cf0-9883-b0d23a71226b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.235479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-718ca003-6d37-4cf0-9883-b0d23a71226b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.238157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:33.239605 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:33.240774 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c8a2554b-c65c-4c91-871d-8de70c4aff74 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.177072 Sep 08 14:00:33.241333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 485/971] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:33 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:33.285056 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-718ca003-6d37-4cf0-9883-b0d23a71226b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:00:33.379312 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-718ca003-6d37-4cf0-9883-b0d23a71226b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "DELETE /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 204 len: 0 microversion: 2.1 time: 0.164481 Sep 08 14:00:33.383492 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 487/972] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:00:33 2022] DELETE /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:00:33.394570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-119b76a0-ed8a-4e95-9af3-4dd2016edb05 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:33.395363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-119b76a0-ed8a-4e95-9af3-4dd2016edb05 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:33.410554 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119b76a0-ed8a-4e95-9af3-4dd2016edb05 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.413425 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119b76a0-ed8a-4e95-9af3-4dd2016edb05 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.414397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119b76a0-ed8a-4e95-9af3-4dd2016edb05 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.415844 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119b76a0-ed8a-4e95-9af3-4dd2016edb05 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.418211 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-af18b9ee-e106-4f5d-8e86-2123da56831a req-0934b8fd-1a3d-4441-885b-59c4f8e9da5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3625263b-e16f-4c5c-a20a-591dca9ca140", "name": "network-vif-plugged", "status": "completed", "tag": "daea8158-0875-402f-9603-ddb321067a70"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:33.418941 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119b76a0-ed8a-4e95-9af3-4dd2016edb05 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.420891 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-119b76a0-ed8a-4e95-9af3-4dd2016edb05 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.451884 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-af18b9ee-e106-4f5d-8e86-2123da56831a req-0934b8fd-1a3d-4441-885b-59c4f8e9da5a service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.452527 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-af18b9ee-e106-4f5d-8e86-2123da56831a req-0934b8fd-1a3d-4441-885b-59c4f8e9da5a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.452967 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-af18b9ee-e106-4f5d-8e86-2123da56831a req-0934b8fd-1a3d-4441-885b-59c4f8e9da5a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.481392 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-af18b9ee-e106-4f5d-8e86-2123da56831a req-0934b8fd-1a3d-4441-885b-59c4f8e9da5a service nova] Creating event network-vif-plugged:daea8158-0875-402f-9603-ddb321067a70 for instance 3625263b-e16f-4c5c-a20a-591dca9ca140 on hv-cinder-82002 Sep 08 14:00:33.487549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-af18b9ee-e106-4f5d-8e86-2123da56831a req-0934b8fd-1a3d-4441-885b-59c4f8e9da5a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081797 Sep 08 14:00:33.488268 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 488/973] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:33.676741 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-119b76a0-ed8a-4e95-9af3-4dd2016edb05 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:33.684662 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-119b76a0-ed8a-4e95-9af3-4dd2016edb05 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1575 microversion: 2.1 time: 0.295526 Sep 08 14:00:33.685422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 486/974] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:33 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1575 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:33.749222 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9719e940-bcdf-4700-85fa-9d44d7e4972a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:33.752355 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9719e940-bcdf-4700-85fa-9d44d7e4972a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:33.760703 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9719e940-bcdf-4700-85fa-9d44d7e4972a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.761335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9719e940-bcdf-4700-85fa-9d44d7e4972a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.762175 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9719e940-bcdf-4700-85fa-9d44d7e4972a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.763451 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9719e940-bcdf-4700-85fa-9d44d7e4972a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.764127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9719e940-bcdf-4700-85fa-9d44d7e4972a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.764562 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9719e940-bcdf-4700-85fa-9d44d7e4972a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.796237 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9719e940-bcdf-4700-85fa-9d44d7e4972a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052687 Sep 08 14:00:33.796809 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 489/975] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 14:00:33 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:33.905572 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9cdba463-35ba-46a5-86d4-073f9dd11fbf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:33.906221 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9cdba463-35ba-46a5-86d4-073f9dd11fbf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:33.912321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cdba463-35ba-46a5-86d4-073f9dd11fbf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.912810 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cdba463-35ba-46a5-86d4-073f9dd11fbf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.913259 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cdba463-35ba-46a5-86d4-073f9dd11fbf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:33.913992 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cdba463-35ba-46a5-86d4-073f9dd11fbf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:33.914526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cdba463-35ba-46a5-86d4-073f9dd11fbf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:33.915029 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9cdba463-35ba-46a5-86d4-073f9dd11fbf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.016052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9cdba463-35ba-46a5-86d4-073f9dd11fbf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:34.024289 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9cdba463-35ba-46a5-86d4-073f9dd11fbf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1613 microversion: 2.1 time: 0.122636 Sep 08 14:00:34.024866 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 487/976] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:33 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:34.240080 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-22a56f65-8c61-4e1b-8712-af4dcc8962dd req-5b8f51de-a5b0-4982-a3cc-1785a64411de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5ce5ad-7f55-4482-bff3-96eb19463f07", "name": "network-vif-deleted", "tag": "e14cb466-443e-415d-b932-45c6f7a15d37"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:34.249757 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-22a56f65-8c61-4e1b-8712-af4dcc8962dd req-5b8f51de-a5b0-4982-a3cc-1785a64411de service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.250240 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-22a56f65-8c61-4e1b-8712-af4dcc8962dd req-5b8f51de-a5b0-4982-a3cc-1785a64411de service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.250663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-22a56f65-8c61-4e1b-8712-af4dcc8962dd req-5b8f51de-a5b0-4982-a3cc-1785a64411de service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.261934 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-22a56f65-8c61-4e1b-8712-af4dcc8962dd req-5b8f51de-a5b0-4982-a3cc-1785a64411de service nova] Creating event network-vif-deleted:e14cb466-443e-415d-b932-45c6f7a15d37 for instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 on hv-cinder-82002 Sep 08 14:00:34.266920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-22a56f65-8c61-4e1b-8712-af4dcc8962dd req-5b8f51de-a5b0-4982-a3cc-1785a64411de service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030458 Sep 08 14:00:34.270633 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 490/977] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:34.275561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:34.276921 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:34.283872 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.284526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.284971 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.285812 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.286376 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.286882 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.430455 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:34.439058 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:34.440480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:34.441636 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ef0afbdf-4935-4e8f-939a-5a9d9332d8e6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.170170 Sep 08 14:00:34.442300 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 488/978] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:34 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:34.714079 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2b998350-b153-4061-8357-08320cad4cf0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:34.715674 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2b998350-b153-4061-8357-08320cad4cf0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:34.732164 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b998350-b153-4061-8357-08320cad4cf0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.732658 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b998350-b153-4061-8357-08320cad4cf0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.733101 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b998350-b153-4061-8357-08320cad4cf0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.733831 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b998350-b153-4061-8357-08320cad4cf0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.734288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b998350-b153-4061-8357-08320cad4cf0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.734715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2b998350-b153-4061-8357-08320cad4cf0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.809167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c804b705-9ae1-4d23-9f93-bbc006366836 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:34.812108 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c804b705-9ae1-4d23-9f93-bbc006366836 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:34.826627 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c804b705-9ae1-4d23-9f93-bbc006366836 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.827156 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c804b705-9ae1-4d23-9f93-bbc006366836 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.827666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c804b705-9ae1-4d23-9f93-bbc006366836 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.828545 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c804b705-9ae1-4d23-9f93-bbc006366836 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:34.829061 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c804b705-9ae1-4d23-9f93-bbc006366836 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:34.830915 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c804b705-9ae1-4d23-9f93-bbc006366836 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:34.865382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c804b705-9ae1-4d23-9f93-bbc006366836 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060652 Sep 08 14:00:34.870102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 489/979] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 14:00:34 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:00:34.955853 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2b998350-b153-4061-8357-08320cad4cf0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:34.967436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2b998350-b153-4061-8357-08320cad4cf0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1575 microversion: 2.1 time: 0.261420 Sep 08 14:00:34.982381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 491/980] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:34 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1575 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:35.049123 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d947eb92-c15b-4f8d-bd77-c774f49a4938 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:35.049917 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d947eb92-c15b-4f8d-bd77-c774f49a4938 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:35.056895 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d947eb92-c15b-4f8d-bd77-c774f49a4938 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.058151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d947eb92-c15b-4f8d-bd77-c774f49a4938 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.058757 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d947eb92-c15b-4f8d-bd77-c774f49a4938 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.059746 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d947eb92-c15b-4f8d-bd77-c774f49a4938 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.060356 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d947eb92-c15b-4f8d-bd77-c774f49a4938 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.060930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d947eb92-c15b-4f8d-bd77-c774f49a4938 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.140833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d947eb92-c15b-4f8d-bd77-c774f49a4938 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e48a8c1b91142cf9d1af17f28e41961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca185497284e9780eba8fc2e713d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:35.149120 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d947eb92-c15b-4f8d-bd77-c774f49a4938 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 200 len: 1326 microversion: 2.1 time: 0.105043 Sep 08 14:00:35.151082 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 490/981] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:35 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:35.468640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:35.469504 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:35.478989 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.479577 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.480081 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.481021 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.481715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.482310 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.778422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:35.786681 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:35.790076 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:35.792526 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b2aa543c-3b7c-4a65-b1a2-f8605f607084 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.329220 Sep 08 14:00:35.793615 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 492/982] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:35 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:35.881396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7441fa69-e5e0-4cad-94d8-dcb43f72c1f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:35.883919 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7441fa69-e5e0-4cad-94d8-dcb43f72c1f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:35.891040 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7441fa69-e5e0-4cad-94d8-dcb43f72c1f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.891776 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7441fa69-e5e0-4cad-94d8-dcb43f72c1f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.892674 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7441fa69-e5e0-4cad-94d8-dcb43f72c1f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.893537 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7441fa69-e5e0-4cad-94d8-dcb43f72c1f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:35.894171 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7441fa69-e5e0-4cad-94d8-dcb43f72c1f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:35.894747 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7441fa69-e5e0-4cad-94d8-dcb43f72c1f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:35.940225 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:35.946589 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7441fa69-e5e0-4cad-94d8-dcb43f72c1f8 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072454 Sep 08 14:00:35.947951 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 491/983] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 14:00:35 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:00:36.004574 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-093cd1d0-1549-428d-b297-a61fbb3a3dba tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:36.005142 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-093cd1d0-1549-428d-b297-a61fbb3a3dba tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:36.015390 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093cd1d0-1549-428d-b297-a61fbb3a3dba tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.016270 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093cd1d0-1549-428d-b297-a61fbb3a3dba tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.016698 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093cd1d0-1549-428d-b297-a61fbb3a3dba tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.017393 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093cd1d0-1549-428d-b297-a61fbb3a3dba tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.019527 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093cd1d0-1549-428d-b297-a61fbb3a3dba tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.019956 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093cd1d0-1549-428d-b297-a61fbb3a3dba tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.133209 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dde217d3-73a1-4b12-bd02-9ee321090b00 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:36.135849 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dde217d3-73a1-4b12-bd02-9ee321090b00 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:36.142363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde217d3-73a1-4b12-bd02-9ee321090b00 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.143166 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde217d3-73a1-4b12-bd02-9ee321090b00 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.143828 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde217d3-73a1-4b12-bd02-9ee321090b00 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.144766 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde217d3-73a1-4b12-bd02-9ee321090b00 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.145444 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde217d3-73a1-4b12-bd02-9ee321090b00 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.145988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dde217d3-73a1-4b12-bd02-9ee321090b00 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.186343 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dde217d3-73a1-4b12-bd02-9ee321090b00 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059505 Sep 08 14:00:36.187558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 492/984] 10.222.0.55 () {58 vars in 1302 bytes} [Thu Sep 8 14:00:36 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:00:36.192562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:36.196223 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:36.203495 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.204271 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.205067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.206047 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.206853 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.207492 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.223337 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 HTTP/1.1 Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:00:36.225423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:36.227052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '4d5ce5ad-7f55-4482-bff3-96eb19463f07'} Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:36.227930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:36.229857 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:36.232525 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:36.233501 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5d8c520c-1286-4de9-89c3-2c9c42761435 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 404 len: 111 microversion: 2.1 time: 0.044815 Sep 08 14:00:36.234313 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 493/985] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:36 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:36.247728 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a0bd859f-d8a5-44dc-b0aa-3c2b438d67cf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '.version_select at 0x7f5be43ef820>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:36.293149 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a0bd859f-d8a5-44dc-b0aa-3c2b438d67cf tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-393235544" status: 202 len: 0 microversion: 2.1 time: 0.052048 Sep 08 14:00:36.294321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 494/986] 10.222.0.55 () {58 vars in 1218 bytes} [Thu Sep 8 14:00:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-393235544 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:00:36.309460 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff21e919-792e-40ad-99be-1252c6ac898f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:36.311438 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff21e919-792e-40ad-99be-1252c6ac898f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:36.320647 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff21e919-792e-40ad-99be-1252c6ac898f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.321430 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff21e919-792e-40ad-99be-1252c6ac898f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.324394 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff21e919-792e-40ad-99be-1252c6ac898f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.326219 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff21e919-792e-40ad-99be-1252c6ac898f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.327096 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff21e919-792e-40ad-99be-1252c6ac898f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.327745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ff21e919-792e-40ad-99be-1252c6ac898f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.367299 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff21e919-792e-40ad-99be-1252c6ac898f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:00:36.403230 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-093cd1d0-1549-428d-b297-a61fbb3a3dba tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:36.414027 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-093cd1d0-1549-428d-b297-a61fbb3a3dba tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1575 microversion: 2.1 time: 0.413302 Sep 08 14:00:36.414602 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 493/987] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:35 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1575 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:36.506506 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff21e919-792e-40ad-99be-1252c6ac898f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 204 len: 0 microversion: 2.1 time: 0.201164 Sep 08 14:00:36.515858 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 495/988] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:00:36 2022] DELETE /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:00:36.520671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7b08339b-8ccb-474a-b7ed-057587a9805a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:36.521534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7b08339b-8ccb-474a-b7ed-057587a9805a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:36.533018 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b08339b-8ccb-474a-b7ed-057587a9805a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.533504 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b08339b-8ccb-474a-b7ed-057587a9805a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.533964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b08339b-8ccb-474a-b7ed-057587a9805a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.534661 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b08339b-8ccb-474a-b7ed-057587a9805a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.535104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b08339b-8ccb-474a-b7ed-057587a9805a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.535516 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7b08339b-8ccb-474a-b7ed-057587a9805a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.568907 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:36.824001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:36.824821 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:36.843087 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.845712 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.847080 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:36.854487 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:36.855161 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:36.860648 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:37.167236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7b08339b-8ccb-474a-b7ed-057587a9805a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:37.180507 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7b08339b-8ccb-474a-b7ed-057587a9805a tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1674 microversion: 2.1 time: 0.663479 Sep 08 14:00:37.197786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 494/989] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:36 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1674 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:37.204459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-1dbf87f9-a0ff-46f8-9a9b-dcd2177bfe5e req-bc32090d-fbb0-4cd4-9104-ef710f591119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335efb35-9bac-46a5-b2d4-4e2936c82aaf", "name": "network-vif-deleted", "tag": "f0cab8b5-a76d-4e29-b91b-c60d3fdf2858"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:37.215378 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1dbf87f9-a0ff-46f8-9a9b-dcd2177bfe5e req-bc32090d-fbb0-4cd4-9104-ef710f591119 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:37.216056 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1dbf87f9-a0ff-46f8-9a9b-dcd2177bfe5e req-bc32090d-fbb0-4cd4-9104-ef710f591119 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:37.216680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-1dbf87f9-a0ff-46f8-9a9b-dcd2177bfe5e req-bc32090d-fbb0-4cd4-9104-ef710f591119 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:37.217991 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:37.231422 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:37.232611 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-1dbf87f9-a0ff-46f8-9a9b-dcd2177bfe5e req-bc32090d-fbb0-4cd4-9104-ef710f591119 service nova] Creating event network-vif-deleted:f0cab8b5-a76d-4e29-b91b-c60d3fdf2858 for instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf on hv-cinder-82002 Sep 08 14:00:37.233671 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:37.235179 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad6f2c54-0e87-4b76-8ebd-6c508a6cc468 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.417038 Sep 08 14:00:37.249794 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 496/990] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:36 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:37.252983 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-1dbf87f9-a0ff-46f8-9a9b-dcd2177bfe5e req-bc32090d-fbb0-4cd4-9104-ef710f591119 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053577 Sep 08 14:00:37.254099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 495/991] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:37.436709 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5eff2bea-1bc9-4067-b266-8b3de4a04619 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:37.437333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5eff2bea-1bc9-4067-b266-8b3de4a04619 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:37.452045 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eff2bea-1bc9-4067-b266-8b3de4a04619 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:37.452847 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eff2bea-1bc9-4067-b266-8b3de4a04619 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:37.453473 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eff2bea-1bc9-4067-b266-8b3de4a04619 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:37.454398 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eff2bea-1bc9-4067-b266-8b3de4a04619 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:37.455017 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eff2bea-1bc9-4067-b266-8b3de4a04619 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:37.460860 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5eff2bea-1bc9-4067-b266-8b3de4a04619 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:37.562439 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5eff2bea-1bc9-4067-b266-8b3de4a04619 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:37.570690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5eff2bea-1bc9-4067-b266-8b3de4a04619 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1507 microversion: 2.1 time: 0.137882 Sep 08 14:00:37.571775 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 497/992] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:37 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1507 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:38.205150 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bafc2ec5-5fdd-4346-ac10-35d5e7d381a4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:38.205871 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bafc2ec5-5fdd-4346-ac10-35d5e7d381a4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:38.216476 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bafc2ec5-5fdd-4346-ac10-35d5e7d381a4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.216899 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bafc2ec5-5fdd-4346-ac10-35d5e7d381a4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.217337 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bafc2ec5-5fdd-4346-ac10-35d5e7d381a4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.218072 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bafc2ec5-5fdd-4346-ac10-35d5e7d381a4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.218530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bafc2ec5-5fdd-4346-ac10-35d5e7d381a4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.219001 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bafc2ec5-5fdd-4346-ac10-35d5e7d381a4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.266498 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:38.270678 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:38.283186 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.284016 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.284634 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.285502 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.286201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.286864 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.472303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-bafc2ec5-5fdd-4346-ac10-35d5e7d381a4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:38.489038 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bafc2ec5-5fdd-4346-ac10-35d5e7d381a4 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1674 microversion: 2.1 time: 0.288542 Sep 08 14:00:38.497829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 496/993] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:38 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1674 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:38.517077 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:38.527323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:38.528869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:38.530104 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-5b39dbb6-f0d5-4a4d-bba2-68e9557bceef tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.267448 Sep 08 14:00:38.530962 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 498/994] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:38 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:38.595023 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a1b5d2e9-a767-4ce7-b503-22a63114ba7a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:38.595914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a1b5d2e9-a767-4ce7-b503-22a63114ba7a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:38.602574 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b5d2e9-a767-4ce7-b503-22a63114ba7a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.603367 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b5d2e9-a767-4ce7-b503-22a63114ba7a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.604070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b5d2e9-a767-4ce7-b503-22a63114ba7a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.605112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b5d2e9-a767-4ce7-b503-22a63114ba7a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:38.605809 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b5d2e9-a767-4ce7-b503-22a63114ba7a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:38.606447 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a1b5d2e9-a767-4ce7-b503-22a63114ba7a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:38.675813 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a1b5d2e9-a767-4ce7-b503-22a63114ba7a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:38.684436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a1b5d2e9-a767-4ce7-b503-22a63114ba7a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1507 microversion: 2.1 time: 0.093467 Sep 08 14:00:38.685350 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 497/995] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:38 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1507 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:39.515348 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b1f0600d-7daa-44e2-ad46-745aad5d812e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:39.516605 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b1f0600d-7daa-44e2-ad46-745aad5d812e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:39.523257 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f0600d-7daa-44e2-ad46-745aad5d812e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.523981 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f0600d-7daa-44e2-ad46-745aad5d812e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.524610 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f0600d-7daa-44e2-ad46-745aad5d812e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.526017 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f0600d-7daa-44e2-ad46-745aad5d812e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.526666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f0600d-7daa-44e2-ad46-745aad5d812e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.527098 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b1f0600d-7daa-44e2-ad46-745aad5d812e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.560048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:39.560663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:39.567785 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.568666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.569104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.570158 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.570611 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.571032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.706480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b1f0600d-7daa-44e2-ad46-745aad5d812e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:39.716485 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b1f0600d-7daa-44e2-ad46-745aad5d812e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1674 microversion: 2.1 time: 0.206532 Sep 08 14:00:39.718091 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 499/996] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:39 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1674 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:39.729396 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ba291c2-91fc-4bed-be21-52023b2aa5a0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:39.730264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ba291c2-91fc-4bed-be21-52023b2aa5a0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:39.738046 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba291c2-91fc-4bed-be21-52023b2aa5a0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.738749 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba291c2-91fc-4bed-be21-52023b2aa5a0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.742386 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba291c2-91fc-4bed-be21-52023b2aa5a0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.743298 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba291c2-91fc-4bed-be21-52023b2aa5a0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:39.743683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba291c2-91fc-4bed-be21-52023b2aa5a0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:39.744657 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ba291c2-91fc-4bed-be21-52023b2aa5a0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:39.783771 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:39.797049 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:39.798608 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:39.799979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a113ce7e-2408-4acd-ae03-1d035e01fceb tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.246239 Sep 08 14:00:39.816061 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 498/997] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:39 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:00:39.821802 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ba291c2-91fc-4bed-be21-52023b2aa5a0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:39.831277 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ba291c2-91fc-4bed-be21-52023b2aa5a0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1507 microversion: 2.1 time: 0.111955 Sep 08 14:00:39.832008 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 500/998] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:39 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1507 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:40.748844 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-80c9287b-45be-4dae-a3e9-2db2d311a86e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:40.752328 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-80c9287b-45be-4dae-a3e9-2db2d311a86e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:40.786649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80c9287b-45be-4dae-a3e9-2db2d311a86e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.787574 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80c9287b-45be-4dae-a3e9-2db2d311a86e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.788243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80c9287b-45be-4dae-a3e9-2db2d311a86e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:40.790724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80c9287b-45be-4dae-a3e9-2db2d311a86e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.791461 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80c9287b-45be-4dae-a3e9-2db2d311a86e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.792156 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-80c9287b-45be-4dae-a3e9-2db2d311a86e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:40.829280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:40.830643 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:40.845756 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.849314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.850223 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:40.852075 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:40.854358 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:40.857007 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.199946 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-80c9287b-45be-4dae-a3e9-2db2d311a86e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:41.210653 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-80c9287b-45be-4dae-a3e9-2db2d311a86e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1674 microversion: 2.1 time: 0.473637 Sep 08 14:00:41.227560 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 499/999] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:40 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1674 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:41.227560 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:41.227560 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:41.227560 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.227560 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.228104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.228104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.228104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.228368 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.267862 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.268360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.281765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.281765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lazy-loading 'fault' on Instance uuid 335efb35-9bac-46a5-b2d4-4e2936c82aaf {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:00:41.700197 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:41.713035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:41.713274 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:41.715691 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:41.717321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1a299fab-b911-4ea7-917e-d60a83c5abfa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.891974 Sep 08 14:00:41.718108 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 501/1000] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:40 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:00:41.723236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e07a5d0f-d274-426c-80cd-b68e4bbea84e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 200 len: 1229 microversion: 2.1 time: 0.510543 Sep 08 14:00:41.724068 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 500/1001] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:41 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 1229 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:41.818769 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:41.819268 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:41.826749 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.827604 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.828339 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.829253 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.829891 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.831091 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.848369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 HTTP/1.1 Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:00:41.850534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:41.854231 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '4d5ce5ad-7f55-4482-bff3-96eb19463f07'} Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:41.855039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:41.857461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:41.860035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:41.860035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-018a54ad-5d42-41a3-871f-541b0c5a9a1f tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 404 len: 111 microversion: 2.1 time: 0.038801 Sep 08 14:00:41.860035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 502/1002] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:00:41 2022] DELETE /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:41.863090 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:41.863654 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 4d5ce5ad-7f55-4482-bff3-96eb19463f07] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:41.874617 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.875405 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.875849 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.876612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:41.877092 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:41.877681 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:41.895779 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 HTTP/1.1 Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:00:41.898100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:41.899435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '4d5ce5ad-7f55-4482-bff3-96eb19463f07'} Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:41.900770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. Sep 08 14:00:41.902070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:41.905697 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance 4d5ce5ad-7f55-4482-bff3-96eb19463f07 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:41.906809 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c527bf13-d5ca-4f02-886f-fa06388120fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07" status: 404 len: 111 microversion: 2.1 time: 0.048901 Sep 08 14:00:41.908040 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 501/1003] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:41 2022] GET /compute/v2.1/servers/4d5ce5ad-7f55-4482-bff3-96eb19463f07 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:42.236562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3f7533c4-d9a9-4b71-9e2f-afeea222cceb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:42.237711 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3f7533c4-d9a9-4b71-9e2f-afeea222cceb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:42.258000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7533c4-d9a9-4b71-9e2f-afeea222cceb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:42.258765 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7533c4-d9a9-4b71-9e2f-afeea222cceb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:42.259209 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7533c4-d9a9-4b71-9e2f-afeea222cceb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:42.260547 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7533c4-d9a9-4b71-9e2f-afeea222cceb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:42.261230 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7533c4-d9a9-4b71-9e2f-afeea222cceb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:42.261982 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3f7533c4-d9a9-4b71-9e2f-afeea222cceb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:42.427724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3f7533c4-d9a9-4b71-9e2f-afeea222cceb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96744eb6a9cf4895b6101e209d1fdd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6998e0c9a62e4f54a27faf56dbeb543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:42.439817 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3f7533c4-d9a9-4b71-9e2f-afeea222cceb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 200 len: 1606 microversion: 2.1 time: 0.208338 Sep 08 14:00:42.443622 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 503/1004] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:42 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 1606 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:42.513996 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-ff769f01-0422-4eb7-9215-3a2668956386 req-f72f1093-d5e5-4904-b93b-05c519e6dd8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e839a72-e12e-4617-88c9-ed12f748c399", "name": "network-vif-deleted", "tag": "1e7eb6da-3323-4042-81a8-99078c8d7b4e"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:42.531477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ff769f01-0422-4eb7-9215-3a2668956386 req-f72f1093-d5e5-4904-b93b-05c519e6dd8a service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:42.533137 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ff769f01-0422-4eb7-9215-3a2668956386 req-f72f1093-d5e5-4904-b93b-05c519e6dd8a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:42.535803 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-ff769f01-0422-4eb7-9215-3a2668956386 req-f72f1093-d5e5-4904-b93b-05c519e6dd8a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:42.574936 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-ff769f01-0422-4eb7-9215-3a2668956386 req-f72f1093-d5e5-4904-b93b-05c519e6dd8a service nova] Creating event network-vif-deleted:1e7eb6da-3323-4042-81a8-99078c8d7b4e for instance 9e839a72-e12e-4617-88c9-ed12f748c399 on hv-cinder-82002 Sep 08 14:00:42.581373 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-ff769f01-0422-4eb7-9215-3a2668956386 req-f72f1093-d5e5-4904-b93b-05c519e6dd8a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071316 Sep 08 14:00:42.585875 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 502/1005] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:42.768002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:42.768635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:42.769405 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:42.773860 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:42.790342 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:42.792622 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:42.794304 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:42.795168 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:42.795789 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:42.796579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:42.797438 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:42.798477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:42.798626 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:42.798922 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:42.799731 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:42.800323 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:42.835303 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] HTTP exception thrown: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Request method failure captured: Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf HTTP/1.1 Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfTEfgn9hqwcQPTZjtjIi_eZbPKBSZw4vbtM7d4LDTgTlcj95rmQME9s9ofUwi3UgHEetwgR-HYhHHMhkou9zN7Go1J_4TsEl0CStTihhXJBw0-4FiYZ7_Xbzi_KVKJVLaXtQ1j1RKE660Xb89-XiiivL_hq3Ec1JfVTeZJOpwvAskc Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 19d114fd258a4306b4c0665df90ae4c7 Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-TestVolumeBootPattern-572502475 Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:00:42.836943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19d114fd258a4306b4c0665df90ae4c7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-TestVolumeBootPattern-572502475 Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 19d114fd258a4306b4c0665df90ae4c7 Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestVolumeBootPattern-572502475 Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-TestVolumeBootPattern-572502475-project Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 76a9dc3ddb144e599a2856fce8dc339d Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-TestVolumeBootPattern-572502475-project Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:00:42.839151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '335efb35-9bac-46a5-b2d4-4e2936c82aaf'} Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:42.840437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:00:42.841913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:42.843369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Returning 404 to user: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:42.843369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-01f56fab-eb43-423e-a662-a32ba28482c6 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 404 len: 111 microversion: 2.1 time: 0.089146 Sep 08 14:00:42.856321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 504/1006] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:42 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:43.016595 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-678138904", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-327996144", "security_groups": [{"name": "tempest-secgroup-smoke-1471578861"}], "block_device_mapping_v2": [{"uuid": "a3178dcb-e31e-40b4-818b-2fd1381d32d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "551d8846-f844-4925-a2fe-eef49820f7af"}]}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:43.167715 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:43.178745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:43.180202 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:43.181407 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8231d3c6-cd2e-43bb-bd47-e5e8cb4b947e tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.429986 Sep 08 14:00:43.182005 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 503/1007] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:42 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:43.262530 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.network.neutron [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] validate_networks() for [('551d8846-f844-4925-a2fe-eef49820f7af', None, None, None, None, None)] {{(pid=126920) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:00:43.308156 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:43.308894 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:43.316518 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.317747 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.318359 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.319261 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.319877 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.320930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.348985 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 HTTP/1.1 Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:00:43.352336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 14:00:43.354308 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '30b6fbb8-a2c9-4c92-b120-8ea3259c9b56'} Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:43.355095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 14:00:43.356777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.359126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:43.359126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-fd05e173-3ada-4ccc-b54b-3b2f70bfa0fd tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 404 len: 111 microversion: 2.1 time: 0.050713 Sep 08 14:00:43.359126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 504/1008] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:00:43 2022] DELETE /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:43.365275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:43.366166 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:43.374468 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.375177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.375917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.378469 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.379145 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.379813 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.399052 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 HTTP/1.1 Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:00:43.401546 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 14:00:43.403177 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '30b6fbb8-a2c9-4c92-b120-8ea3259c9b56'} Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:43.404095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. Sep 08 14:00:43.405575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.407981 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance 30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:43.411204 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-39434ed8-9fa6-423b-bd22-97e1cf802043 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56" status: 404 len: 111 microversion: 2.1 time: 0.051928 Sep 08 14:00:43.412333 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 505/1009] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:43 2022] GET /compute/v2.1/servers/30b6fbb8-a2c9-4c92-b120-8ea3259c9b56 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:43.423109 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:43.424571 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:43.438935 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.439664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.440118 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.441664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.442176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.442596 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.481880 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 HTTP/1.1 Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:00:43.483365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 14:00:43.484854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '959f81c9-4c88-41e0-8eb9-e5b3fb5faa32'} Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:43.485798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 14:00:43.487285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.489120 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:43.489120 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-75b05743-5a82-4c66-947b-c50bc215c5d9 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 404 len: 111 microversion: 2.1 time: 0.068063 Sep 08 14:00:43.489120 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 506/1010] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:00:43 2022] DELETE /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:43.493232 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:43.495097 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:43.520962 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.521848 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.522936 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.526983 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.527812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.528494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.547167 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] HTTP exception thrown: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Request method failure captured: Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 HTTP/1.1 Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOrOjix53dZZ-KOn42GSZJ-XTCZC2Jls6slzU5d4mcBdjcp9Qsfc6FIayn-sZJEKs-4VzeniA8eXaUwvw07SwpkxalJrw4rr4bZ6IedNOAYf3sG8TVUgFFRURXr28rI3b5hfkHDsgZnkp4iiVyWvFjQyaSKiCPC3kGP2BGa6Mn0WeY Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:00:43.549121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6998e0c9a62e4f54a27faf56dbeb543a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 96744eb6a9cf4895b6101e209d1fdd29 Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:43.550550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '9e839a72-e12e-4617-88c9-ed12f748c399'} Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:43.551340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:43.552549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.554906 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Returning 404 to user: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:43.555376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac405051-3bc5-46dd-9296-e9b96529baba tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 404 len: 111 microversion: 2.1 time: 0.066074 Sep 08 14:00:43.556188 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 507/1011] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:43 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:43.566691 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:43.569822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:43.590292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.590804 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.591224 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.591937 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:43.592388 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:43.592821 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:43.624824 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 HTTP/1.1 Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:00:43.626416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 14:00:43.627861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '959f81c9-4c88-41e0-8eb9-e5b3fb5faa32'} Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:43.628619 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. Sep 08 14:00:43.631716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:43.634247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance 959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:43.634247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-583bca6d-5305-40de-b5e0-85e3a3d33a6b tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32" status: 404 len: 111 microversion: 2.1 time: 0.067101 Sep 08 14:00:43.634247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 508/1012] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:43 2022] GET /compute/v2.1/servers/959f81c9-4c88-41e0-8eb9-e5b3fb5faa32 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:43.636114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98b50c00-71c8-4607-8d15-5fb487d8b836 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '.version_select at 0x7f5be46ef430>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:43.659250 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-98b50c00-71c8-4607-8d15-5fb487d8b836 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-536423575" status: 202 len: 0 microversion: 2.1 time: 0.029259 Sep 08 14:00:43.660530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 509/1013] 10.222.0.55 () {58 vars in 1218 bytes} [Thu Sep 8 14:00:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-536423575 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:00:44.067718 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Flavor limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:00:44.068946 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Image limits 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:00:44.070158 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Flavor pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:00:44.071744 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Image pref 0:0:0 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:00:44.072257 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.virt.hardware [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:00:44.092603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.093070 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.093712 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.094622 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.095072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.095490 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.138322 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Getting quotas for project 19d114fd258a4306b4c0665df90ae4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:00:44.142817 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Getting quotas for user 76a9dc3ddb144e599a2856fce8dc339d and project 19d114fd258a4306b4c0665df90ae4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:00:44.216774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:44.217474 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:44.227846 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Going to run 1 instances... {{(pid=126920) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:00:44.231398 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3178dcb-e31e-40b4-818b-2fd1381d32d4',volume_size=None,volume_type=None)] {{(pid=126920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:00:44.232380 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.232872 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.233370 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.234059 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.234517 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.234921 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.477931 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:44.490970 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:44.492805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:44.494381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d8110a2d-8b0d-41fc-b10b-f80068f9d2b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.288089 Sep 08 14:00:44.495629 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 510/1014] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:44 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:00:44.579464 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8a11248b-e00a-4270-b698-e3c2bb514f4e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.571353 Sep 08 14:00:44.580452 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 505/1015] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 14:00:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:00:44.593020 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a5ee70e5-dc5f-49a8-93a5-fe43e8d73326 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:44.593708 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a5ee70e5-dc5f-49a8-93a5-fe43e8d73326 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:44.690630 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a5ee70e5-dc5f-49a8-93a5-fe43e8d73326 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:44.703905 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a5ee70e5-dc5f-49a8-93a5-fe43e8d73326 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1093 microversion: 2.1 time: 0.116086 Sep 08 14:00:44.708569 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 511/1016] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:44 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1093 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:44.925155 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:44.925652 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:44.933597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.943095 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.943555 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.944288 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:44.945481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:44.946090 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:44.976750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce HTTP/1.1 Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:00:44.986280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 14:00:44.987999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': 'c6a4b8e4-4292-4db0-89b6-b09f84f513ce'} Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:44.988944 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 14:00:44.990242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:44.992954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:44.999835 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cf868eee-2967-433d-a48a-ee1e782037df tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 404 len: 111 microversion: 2.1 time: 0.084285 Sep 08 14:00:45.000419 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 506/1017] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:00:44 2022] DELETE /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:45.010679 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:45.011431 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] [instance: c6a4b8e4-4292-4db0-89b6-b09f84f513ce] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:45.017840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.030453 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.031307 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.037797 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.038767 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.039458 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.061321 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] HTTP exception thrown: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Request method failure captured: Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce HTTP/1.1 Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOoM_s-SM-hgBST3t9XWSEIj9qiS_Z3z8NXT1VgnIEommjYxNAhIz26IF35baafuTeWi8mBj3VfP52WsRCwfhKv-8n454mdo-0Ld9A6kK_M2yZHDFgOLmBfBXfNPso6CqhwgYYul4Fr0qMfB4YxfhM7hUjpjTOBqHpR97RQ28Bl4xc Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:00:45.063173 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4ca185497284e9780eba8fc2e713d6e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4ca185497284e9780eba8fc2e713d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: b4ca185497284e9780eba8fc2e713d6e Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847206360 Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 2e48a8c1b91142cf9d1af17f28e41961 Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeNegativeTest-1847206360-project Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 14:00:45.064466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': 'c6a4b8e4-4292-4db0-89b6-b09f84f513ce'} Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:45.066064 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. Sep 08 14:00:45.067287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:45.068383 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] Returning 404 to user: Instance c6a4b8e4-4292-4db0-89b6-b09f84f513ce could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:45.068383 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a4a64637-a07b-4cad-a2a9-fa50b8c7bce5 tempest-AttachVolumeNegativeTest-1847206360 tempest-AttachVolumeNegativeTest-1847206360-project] 10.222.0.55 "GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce" status: 404 len: 111 microversion: 2.1 time: 0.059567 Sep 08 14:00:45.068383 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 512/1018] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:45 2022] GET /compute/v2.1/servers/c6a4b8e4-4292-4db0-89b6-b09f84f513ce => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:45.520813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:45.523973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:45.545186 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.545807 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.546328 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.547235 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.549178 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.550012 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.727221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-95089e26-d2b6-4bbc-8a5a-d153ad724e52 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:45.727924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-95089e26-d2b6-4bbc-8a5a-d153ad724e52 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:45.737602 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95089e26-d2b6-4bbc-8a5a-d153ad724e52 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.738783 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95089e26-d2b6-4bbc-8a5a-d153ad724e52 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.739461 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95089e26-d2b6-4bbc-8a5a-d153ad724e52 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.741170 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95089e26-d2b6-4bbc-8a5a-d153ad724e52 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:45.742007 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95089e26-d2b6-4bbc-8a5a-d153ad724e52 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:45.743228 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-95089e26-d2b6-4bbc-8a5a-d153ad724e52 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:45.808014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:45.816833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:45.818647 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:45.820076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9af1d3be-c043-430a-a500-17a50a1ef7d3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.303598 Sep 08 14:00:45.833758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-95089e26-d2b6-4bbc-8a5a-d153ad724e52 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:45.834621 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 507/1019] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:45 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:45.841456 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-95089e26-d2b6-4bbc-8a5a-d153ad724e52 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1191 microversion: 2.1 time: 0.117995 Sep 08 14:00:45.842075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 513/1020] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:45 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1191 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:46.860272 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:46.861159 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:46.865093 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1c44d97b-60ae-49ac-be07-1a3943d60ff1 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:46.866603 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1c44d97b-60ae-49ac-be07-1a3943d60ff1 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:46.872693 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:46.873206 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:46.873648 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:46.874415 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:46.876200 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:46.876939 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:46.887513 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c44d97b-60ae-49ac-be07-1a3943d60ff1 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:46.888050 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c44d97b-60ae-49ac-be07-1a3943d60ff1 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:46.888495 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c44d97b-60ae-49ac-be07-1a3943d60ff1 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:46.889204 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c44d97b-60ae-49ac-be07-1a3943d60ff1 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:46.889661 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c44d97b-60ae-49ac-be07-1a3943d60ff1 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:46.904218 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1c44d97b-60ae-49ac-be07-1a3943d60ff1 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:47.117260 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-1c44d97b-60ae-49ac-be07-1a3943d60ff1 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:47.128719 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1c44d97b-60ae-49ac-be07-1a3943d60ff1 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1209 microversion: 2.1 time: 0.268002 Sep 08 14:00:47.129617 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 514/1021] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:46 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1209 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:47.320762 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:47.321258 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:47.332190 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:47.338076 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:47.338957 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:47.340529 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:47.341190 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:47.341841 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:47.355685 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:47.366213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:47.370614 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:47.372664 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-625add27-80a2-4cd7-b868-74747deb746c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.517771 Sep 08 14:00:47.374013 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 508/1022] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:46 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:47.376443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] HTTP exception thrown: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Request method failure captured: Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 HTTP/1.1 Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOrOjix53dZZ-KOn42GSZJ-XTCZC2Jls6slzU5d4mcBdjcp9Qsfc6FIayn-sZJEKs-4VzeniA8eXaUwvw07SwpkxalJrw4rr4bZ6IedNOAYf3sG8TVUgFFRURXr28rI3b5hfkHDsgZnkp4iiVyWvFjQyaSKiCPC3kGP2BGa6Mn0WeY Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:00:47.378949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6998e0c9a62e4f54a27faf56dbeb543a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 96744eb6a9cf4895b6101e209d1fdd29 Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:47.380352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '9e839a72-e12e-4617-88c9-ed12f748c399'} Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:47.381135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:47.383139 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:47.385510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Returning 404 to user: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:47.385510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a9075fd8-b095-44dd-a36b-2213f2dc163e tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 404 len: 111 microversion: 2.1 time: 0.063478 Sep 08 14:00:47.385510 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 515/1023] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:00:47 2022] DELETE /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:00:47.399186 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:47.400226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: 9e839a72-e12e-4617-88c9-ed12f748c399] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:47.409869 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:47.410381 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:47.411035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:47.411933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:47.413228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:47.413850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:47.730570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] HTTP exception thrown: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Request method failure captured: Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 HTTP/1.1 Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOrOjix53dZZ-KOn42GSZJ-XTCZC2Jls6slzU5d4mcBdjcp9Qsfc6FIayn-sZJEKs-4VzeniA8eXaUwvw07SwpkxalJrw4rr4bZ6IedNOAYf3sG8TVUgFFRURXr28rI3b5hfkHDsgZnkp4iiVyWvFjQyaSKiCPC3kGP2BGa6Mn0WeY Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:00:47.733074 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6998e0c9a62e4f54a27faf56dbeb543a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 96744eb6a9cf4895b6101e209d1fdd29 Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:47.734833 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '9e839a72-e12e-4617-88c9-ed12f748c399'} Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:47.735706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. Sep 08 14:00:47.737201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:47.739531 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Returning 404 to user: Instance 9e839a72-e12e-4617-88c9-ed12f748c399 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:47.740573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-43702f74-eec2-4c3b-a69d-df3cfb4e0252 tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399" status: 404 len: 111 microversion: 2.1 time: 0.346953 Sep 08 14:00:47.742125 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 509/1024] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:47 2022] GET /compute/v2.1/servers/9e839a72-e12e-4617-88c9-ed12f748c399 => generated 111 bytes in 349 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:48.153788 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-164c5796-6220-4996-ae16-fe48306f5649 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:48.154405 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-164c5796-6220-4996-ae16-fe48306f5649 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:48.162113 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164c5796-6220-4996-ae16-fe48306f5649 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.162607 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164c5796-6220-4996-ae16-fe48306f5649 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.163046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164c5796-6220-4996-ae16-fe48306f5649 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.163756 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164c5796-6220-4996-ae16-fe48306f5649 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.164213 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164c5796-6220-4996-ae16-fe48306f5649 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.164691 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-164c5796-6220-4996-ae16-fe48306f5649 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.403137 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:48.404079 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:48.413829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.414319 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.414752 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.415460 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.416086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.416514 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.531981 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-164c5796-6220-4996-ae16-fe48306f5649 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:48.539747 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-164c5796-6220-4996-ae16-fe48306f5649 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.390543 Sep 08 14:00:48.540314 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 516/1025] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:48 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:48.680486 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:48.688459 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:48.690016 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:48.691253 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5763629-e8dd-45f0-909d-eaf9fd3bfca4 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1741 microversion: 2.20 time: 0.292780 Sep 08 14:00:48.691883 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 510/1026] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:48 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:00:48.983912 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:48.984742 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:48.995521 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.996334 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.997236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.998149 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.998859 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.999443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.018516 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] HTTP exception thrown: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Request method failure captured: Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: DELETE /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 HTTP/1.1 Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfOrOjix53dZZ-KOn42GSZJ-XTCZC2Jls6slzU5d4mcBdjcp9Qsfc6FIayn-sZJEKs-4VzeniA8eXaUwvw07SwpkxalJrw4rr4bZ6IedNOAYf3sG8TVUgFFRURXr28rI3b5hfkHDsgZnkp4iiVyWvFjQyaSKiCPC3kGP2BGa6Mn0WeY Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:00:49.020682 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6998e0c9a62e4f54a27faf56dbeb543a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 96744eb6a9cf4895b6101e209d1fdd29 Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 14:00:49.022303 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': 'd2ad7906-3b73-4fc9-a692-9692fb6234b3'} Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:49.023185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 14:00:49.024699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:00:49.027567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Returning 404 to user: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:49.028777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ce6f89eb-3859-4ee3-9ae2-e1d79d9d3d4f tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 404 len: 111 microversion: 2.1 time: 0.052579 Sep 08 14:00:49.029897 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 517/1027] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:00:48 2022] DELETE /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:49.040815 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:49.042429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] [instance: d2ad7906-3b73-4fc9-a692-9692fb6234b3] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:49.052888 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.053874 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.054600 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.055467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.056077 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.057378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.074600 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] HTTP exception thrown: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Request method failure captured: Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 HTTP/1.1 Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfOrOjix53dZZ-KOn42GSZJ-XTCZC2Jls6slzU5d4mcBdjcp9Qsfc6FIayn-sZJEKs-4VzeniA8eXaUwvw07SwpkxalJrw4rr4bZ6IedNOAYf3sG8TVUgFFRURXr28rI3b5hfkHDsgZnkp4iiVyWvFjQyaSKiCPC3kGP2BGa6Mn0WeY Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:00:49.076426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6998e0c9a62e4f54a27faf56dbeb543a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6998e0c9a62e4f54a27faf56dbeb543a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 6998e0c9a62e4f54a27faf56dbeb543a Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1451638346 Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 96744eb6a9cf4895b6101e209d1fdd29 Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeTestJSON-1451638346-project Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 14:00:49.077791 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': 'd2ad7906-3b73-4fc9-a692-9692fb6234b3'} Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:00:49.078667 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. Sep 08 14:00:49.080122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:00:49.082470 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] Returning 404 to user: Instance d2ad7906-3b73-4fc9-a692-9692fb6234b3 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:00:49.083478 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-74bfc8ec-4012-417a-a1f7-2585bb06f2bb tempest-AttachVolumeTestJSON-1451638346 tempest-AttachVolumeTestJSON-1451638346-project] 10.222.0.55 "GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3" status: 404 len: 111 microversion: 2.1 time: 0.049662 Sep 08 14:00:49.084651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 511/1028] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:49 2022] GET /compute/v2.1/servers/d2ad7906-3b73-4fc9-a692-9692fb6234b3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:49.563287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e982c6d3-20be-4f77-96a3-87770bcdee76 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:49.564644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e982c6d3-20be-4f77-96a3-87770bcdee76 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:49.574723 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982c6d3-20be-4f77-96a3-87770bcdee76 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.575517 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982c6d3-20be-4f77-96a3-87770bcdee76 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.576162 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982c6d3-20be-4f77-96a3-87770bcdee76 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.577102 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982c6d3-20be-4f77-96a3-87770bcdee76 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.578034 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982c6d3-20be-4f77-96a3-87770bcdee76 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.578670 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e982c6d3-20be-4f77-96a3-87770bcdee76 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.717932 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:49.718525 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:49.724968 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.725452 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.725916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.726795 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.727251 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.727672 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.748782 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:50.058413 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e982c6d3-20be-4f77-96a3-87770bcdee76 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:50.068996 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e982c6d3-20be-4f77-96a3-87770bcdee76 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.508407 Sep 08 14:00:50.074729 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 518/1029] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:49 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:50.248613 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:50.261050 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:50.262963 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:50.264619 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4614fa92-1e11-4142-a085-694269909090 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1723 microversion: 2.20 time: 0.550569 Sep 08 14:00:50.265360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 512/1030] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:49 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1723 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:00:50.671685 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-56e7bf11-1671-4622-b3f3-b55d41ea36a8 req-9c9d1620-6959-40b0-a0ca-8d2632b31352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0fbbab-644f-4d57-b4bf-644204a5b26f", "tag": "07945f23-93ca-4174-93c3-7352e02ec6a5"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:50.685634 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-56e7bf11-1671-4622-b3f3-b55d41ea36a8 req-9c9d1620-6959-40b0-a0ca-8d2632b31352 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:50.686244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-56e7bf11-1671-4622-b3f3-b55d41ea36a8 req-9c9d1620-6959-40b0-a0ca-8d2632b31352 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:50.686752 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-56e7bf11-1671-4622-b3f3-b55d41ea36a8 req-9c9d1620-6959-40b0-a0ca-8d2632b31352 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:50.698439 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-56e7bf11-1671-4622-b3f3-b55d41ea36a8 req-9c9d1620-6959-40b0-a0ca-8d2632b31352 service nova] Creating event network-changed:07945f23-93ca-4174-93c3-7352e02ec6a5 for instance 6c0fbbab-644f-4d57-b4bf-644204a5b26f on hv-cinder-82002 Sep 08 14:00:50.704051 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-56e7bf11-1671-4622-b3f3-b55d41ea36a8 req-9c9d1620-6959-40b0-a0ca-8d2632b31352 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037955 Sep 08 14:00:50.704904 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 519/1031] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:51.098641 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09b34586-5076-406d-bf94-43b5c8d62e45 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:51.100943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-09b34586-5076-406d-bf94-43b5c8d62e45 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:51.112998 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09b34586-5076-406d-bf94-43b5c8d62e45 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:51.114195 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09b34586-5076-406d-bf94-43b5c8d62e45 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:51.114906 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09b34586-5076-406d-bf94-43b5c8d62e45 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.116076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09b34586-5076-406d-bf94-43b5c8d62e45 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:51.116763 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09b34586-5076-406d-bf94-43b5c8d62e45 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:51.117386 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09b34586-5076-406d-bf94-43b5c8d62e45 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.291932 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:51.293140 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:51.299174 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:51.299663 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:51.300092 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.300796 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:51.301245 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:51.301666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:51.672764 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-09b34586-5076-406d-bf94-43b5c8d62e45 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:51.680826 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-09b34586-5076-406d-bf94-43b5c8d62e45 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.587999 Sep 08 14:00:51.694510 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 513/1032] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:51 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:51.704021 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:51.708048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:51.715354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:51.716920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:51.718237 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ea00f3cb-7e89-46ca-9887-43232cc74092 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1723 microversion: 2.20 time: 0.431339 Sep 08 14:00:51.718922 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 520/1033] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:51 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1723 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:00:52.704785 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9ea947ee-192c-477e-88ef-3ab81da03b62 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:52.706095 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9ea947ee-192c-477e-88ef-3ab81da03b62 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:52.713994 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ea947ee-192c-477e-88ef-3ab81da03b62 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:52.714774 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ea947ee-192c-477e-88ef-3ab81da03b62 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:52.715636 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ea947ee-192c-477e-88ef-3ab81da03b62 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:52.716508 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ea947ee-192c-477e-88ef-3ab81da03b62 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:52.717368 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ea947ee-192c-477e-88ef-3ab81da03b62 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:52.717975 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9ea947ee-192c-477e-88ef-3ab81da03b62 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:52.747373 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:52.748949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:52.758567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:52.763267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:52.765673 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:52.768248 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:52.768900 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:52.772700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.185847 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9ea947ee-192c-477e-88ef-3ab81da03b62 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:53.194102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9ea947ee-192c-477e-88ef-3ab81da03b62 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.493335 Sep 08 14:00:53.194605 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 514/1034] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:52 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:53.210341 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:53.220028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:53.221651 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:53.222947 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-b35de1a7-89c9-4bea-841f-8164aab8588f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1726 microversion: 2.20 time: 0.482514 Sep 08 14:00:53.223752 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 521/1035] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:52 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1726 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:00:53.265381 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-774ea9b3-0c27-41c4-bccd-dbef6dfe2044 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec7f2849-20c7-4247-8882-b17afd2a0c93"}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:53.270632 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-774ea9b3-0c27-41c4-bccd-dbef6dfe2044 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:53.278706 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774ea9b3-0c27-41c4-bccd-dbef6dfe2044 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.279911 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774ea9b3-0c27-41c4-bccd-dbef6dfe2044 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.280513 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774ea9b3-0c27-41c4-bccd-dbef6dfe2044 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.281590 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774ea9b3-0c27-41c4-bccd-dbef6dfe2044 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.282447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774ea9b3-0c27-41c4-bccd-dbef6dfe2044 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.283323 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-774ea9b3-0c27-41c4-bccd-dbef6dfe2044 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.377664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-4001fdfc-c8f7-411a-9d5a-66301043b5de req-58b4ae56-49bd-480c-bc35-896646295f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3625263b-e16f-4c5c-a20a-591dca9ca140", "name": "network-vif-unplugged", "status": "completed", "tag": "daea8158-0875-402f-9603-ddb321067a70"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:53.398317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4001fdfc-c8f7-411a-9d5a-66301043b5de req-58b4ae56-49bd-480c-bc35-896646295f3d service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.398983 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4001fdfc-c8f7-411a-9d5a-66301043b5de req-58b4ae56-49bd-480c-bc35-896646295f3d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.400072 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-4001fdfc-c8f7-411a-9d5a-66301043b5de req-58b4ae56-49bd-480c-bc35-896646295f3d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.416215 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.compute.server_external_events [req-4001fdfc-c8f7-411a-9d5a-66301043b5de req-58b4ae56-49bd-480c-bc35-896646295f3d service nova] Unable to find a host for instance 3625263b-e16f-4c5c-a20a-591dca9ca140. Dropping event network-vif-unplugged {{(pid=126919) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 14:00:53.417648 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-4001fdfc-c8f7-411a-9d5a-66301043b5de req-58b4ae56-49bd-480c-bc35-896646295f3d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044281 Sep 08 14:00:53.418765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 522/1036] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 14:00:53.624875 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-774ea9b3-0c27-41c4-bccd-dbef6dfe2044 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "POST /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.378806 Sep 08 14:00:53.625773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 515/1037] 10.222.0.55 () {62 vars in 1364 bytes} [Thu Sep 8 14:00:53 2022] POST /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/os-volume_attachments => generated 188 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:00:53.761478 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f0c5dac5-f691-4e33-8af4-c8b79e8c4d19 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:53.762343 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f0c5dac5-f691-4e33-8af4-c8b79e8c4d19 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:53.773551 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c5dac5-f691-4e33-8af4-c8b79e8c4d19 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.774199 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c5dac5-f691-4e33-8af4-c8b79e8c4d19 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.774498 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c5dac5-f691-4e33-8af4-c8b79e8c4d19 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:53.775250 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c5dac5-f691-4e33-8af4-c8b79e8c4d19 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:53.775699 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c5dac5-f691-4e33-8af4-c8b79e8c4d19 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:53.776307 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f0c5dac5-f691-4e33-8af4-c8b79e8c4d19 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:54.065929 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f0c5dac5-f691-4e33-8af4-c8b79e8c4d19 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/os-volume_attachments/ec7f2849-20c7-4247-8882-b17afd2a0c93" status: 202 len: 0 microversion: 2.20 time: 0.308601 Sep 08 14:00:54.067282 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 523/1038] 10.222.0.55 () {60 vars in 1457 bytes} [Thu Sep 8 14:00:53 2022] DELETE /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/os-volume_attachments/ec7f2849-20c7-4247-8882-b17afd2a0c93 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:00:54.152774 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d5d896d4-eb17-4885-89a8-33d213e9f499 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:54.153783 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d5d896d4-eb17-4885-89a8-33d213e9f499 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:54.160438 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=2 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:54.161466 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:54.164595 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d896d4-eb17-4885-89a8-33d213e9f499 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:54.165329 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d896d4-eb17-4885-89a8-33d213e9f499 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:54.166568 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d896d4-eb17-4885-89a8-33d213e9f499 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:54.167535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d896d4-eb17-4885-89a8-33d213e9f499 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:54.168057 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d896d4-eb17-4885-89a8-33d213e9f499 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:54.168686 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d5d896d4-eb17-4885-89a8-33d213e9f499 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:54.220039 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa230560-5653-44fd-90d2-f10c69a577e5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:54.221571 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aa230560-5653-44fd-90d2-f10c69a577e5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:54.233526 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa230560-5653-44fd-90d2-f10c69a577e5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:54.235719 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa230560-5653-44fd-90d2-f10c69a577e5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:54.236357 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa230560-5653-44fd-90d2-f10c69a577e5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:54.238581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa230560-5653-44fd-90d2-f10c69a577e5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:54.241264 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa230560-5653-44fd-90d2-f10c69a577e5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:54.242848 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d5d896d4-eb17-4885-89a8-33d213e9f499 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126920) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 14:00:54.243895 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa230560-5653-44fd-90d2-f10c69a577e5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:54.349206 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d5d896d4-eb17-4885-89a8-33d213e9f499 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "POST /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/action" status: 202 len: 0 microversion: 2.20 time: 0.200730 Sep 08 14:00:54.354378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 516/1039] 10.222.0.55 () {62 vars in 1319 bytes} [Thu Sep 8 14:00:54 2022] POST /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:00:54.360647 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:54.361511 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:54.368639 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:54.370403 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:54.371053 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:54.371659 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:54.372771 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:54.373482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:54.374144 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:54.503136 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-aa230560-5653-44fd-90d2-f10c69a577e5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:54.511965 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aa230560-5653-44fd-90d2-f10c69a577e5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.297247 Sep 08 14:00:54.512558 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 524/1040] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:54 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:54.636532 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:54.646218 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:54.647909 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:54.650494 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-323b30e6-3d69-4663-99b7-24481534b27b tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1674 microversion: 2.20 time: 0.293147 Sep 08 14:00:54.651375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 517/1041] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:54 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1674 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:55.542111 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-23fa5e2a-722a-42e8-95fa-1acf4b2232bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:55.542738 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-23fa5e2a-722a-42e8-95fa-1acf4b2232bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:55.544878 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:55.550794 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23fa5e2a-722a-42e8-95fa-1acf4b2232bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:55.551347 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23fa5e2a-722a-42e8-95fa-1acf4b2232bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:55.552015 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23fa5e2a-722a-42e8-95fa-1acf4b2232bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:55.553592 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23fa5e2a-722a-42e8-95fa-1acf4b2232bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:55.554160 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23fa5e2a-722a-42e8-95fa-1acf4b2232bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:55.554653 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-23fa5e2a-722a-42e8-95fa-1acf4b2232bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:55.680817 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:55.682185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:55.689308 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:55.689824 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:55.690259 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:55.691055 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:55.691399 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:55.691814 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:55.724793 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-23fa5e2a-722a-42e8-95fa-1acf4b2232bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:55.732943 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-23fa5e2a-722a-42e8-95fa-1acf4b2232bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.194855 Sep 08 14:00:55.745095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 525/1042] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:55 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:55.959245 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:55.971394 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:55.973456 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:55.975039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e947a9c1-3757-4f59-b97c-ffc53d2e6dfc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1676 microversion: 2.20 time: 0.299432 Sep 08 14:00:55.976124 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 518/1043] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:55 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1676 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:00:56.756362 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1269c309-c277-4ff9-b11e-d5270e81f6d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:56.757536 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1269c309-c277-4ff9-b11e-d5270e81f6d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:56.764513 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1269c309-c277-4ff9-b11e-d5270e81f6d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:56.764998 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1269c309-c277-4ff9-b11e-d5270e81f6d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:56.765433 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1269c309-c277-4ff9-b11e-d5270e81f6d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:56.766161 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1269c309-c277-4ff9-b11e-d5270e81f6d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:56.766611 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1269c309-c277-4ff9-b11e-d5270e81f6d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:56.767032 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1269c309-c277-4ff9-b11e-d5270e81f6d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:56.909135 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-1269c309-c277-4ff9-b11e-d5270e81f6d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:56.917287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1269c309-c277-4ff9-b11e-d5270e81f6d7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.164771 Sep 08 14:00:56.917960 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 526/1044] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:56 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:57.006201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:57.006956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:57.016230 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:57.016861 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:57.017526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:57.019060 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:57.019583 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:57.020440 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:57.157723 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:57.167880 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:57.169327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:57.170702 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bf444b1c-32c5-4b84-9dbd-dff3f3f19232 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.168646 Sep 08 14:00:57.171328 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 519/1045] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:57 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:57.940331 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d045aff8-11fd-45f0-87e3-17fc64601c77 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:57.941011 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d045aff8-11fd-45f0-87e3-17fc64601c77 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:57.947534 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d045aff8-11fd-45f0-87e3-17fc64601c77 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:57.948214 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d045aff8-11fd-45f0-87e3-17fc64601c77 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:57.948833 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d045aff8-11fd-45f0-87e3-17fc64601c77 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:57.950248 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d045aff8-11fd-45f0-87e3-17fc64601c77 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:57.951025 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d045aff8-11fd-45f0-87e3-17fc64601c77 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:57.951784 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d045aff8-11fd-45f0-87e3-17fc64601c77 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:58.196468 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:58.197759 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:58.217571 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:58.218373 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:58.218815 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:58.219536 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:58.219988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:58.220412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:58.402233 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d045aff8-11fd-45f0-87e3-17fc64601c77 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:58.419526 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d045aff8-11fd-45f0-87e3-17fc64601c77 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.482952 Sep 08 14:00:58.433922 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 527/1046] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:57 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:58.499919 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:58.508039 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:58.510556 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:58.511716 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-552e5f92-df2d-4a7d-950b-99d03bb0290c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.319136 Sep 08 14:00:58.512264 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 520/1047] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:58 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:00:59.449272 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5af1f321-d89c-4f30-bf90-c9aa4de1f040 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:59.450077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5af1f321-d89c-4f30-bf90-c9aa4de1f040 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:59.456503 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5af1f321-d89c-4f30-bf90-c9aa4de1f040 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:59.456986 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5af1f321-d89c-4f30-bf90-c9aa4de1f040 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:59.457412 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5af1f321-d89c-4f30-bf90-c9aa4de1f040 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:59.458137 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5af1f321-d89c-4f30-bf90-c9aa4de1f040 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:59.458591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5af1f321-d89c-4f30-bf90-c9aa4de1f040 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:59.459006 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5af1f321-d89c-4f30-bf90-c9aa4de1f040 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:59.539148 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:59.539994 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:59.552346 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:59.552904 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:59.553497 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:59.554315 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:59.555730 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:59.556724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:59.713060 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5af1f321-d89c-4f30-bf90-c9aa4de1f040 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:59.722860 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5af1f321-d89c-4f30-bf90-c9aa4de1f040 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.277946 Sep 08 14:00:59.728726 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 528/1048] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:59 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:00:59.818041 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:59.826277 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:59.827750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:59.828978 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4ad06391-b1e2-4383-ab76-b4a3e721b49a tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.295257 Sep 08 14:00:59.829548 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 521/1049] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:00:59 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:00.747588 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-81375675-787c-4bd5-885b-0ad238d398bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:00.749494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-81375675-787c-4bd5-885b-0ad238d398bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:00.752183 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:00.758427 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81375675-787c-4bd5-885b-0ad238d398bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:00.759933 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81375675-787c-4bd5-885b-0ad238d398bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:00.760371 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81375675-787c-4bd5-885b-0ad238d398bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:00.761364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81375675-787c-4bd5-885b-0ad238d398bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:00.761853 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81375675-787c-4bd5-885b-0ad238d398bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:00.762278 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-81375675-787c-4bd5-885b-0ad238d398bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:00.858147 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:00.859407 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:00.868084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:00.868618 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:00.869057 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:00.869797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:00.870255 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:00.870684 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:01.073235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-81375675-787c-4bd5-885b-0ad238d398bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:01.084366 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-81375675-787c-4bd5-885b-0ad238d398bc tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.339159 Sep 08 14:01:01.085304 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 529/1050] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:00 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:01.172067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:01.181554 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:01.184328 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:01.186124 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cd382823-3e5a-4860-8419-5ce83f099370 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.334613 Sep 08 14:01:01.187509 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 522/1051] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:00 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:01:02.107707 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7c53f818-738a-442a-8c42-4a6399617be8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:02.108364 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7c53f818-738a-442a-8c42-4a6399617be8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:02.119947 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c53f818-738a-442a-8c42-4a6399617be8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:02.120575 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c53f818-738a-442a-8c42-4a6399617be8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:02.121327 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c53f818-738a-442a-8c42-4a6399617be8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:02.122046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c53f818-738a-442a-8c42-4a6399617be8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:02.122664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c53f818-738a-442a-8c42-4a6399617be8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:02.123158 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7c53f818-738a-442a-8c42-4a6399617be8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:02.213005 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:02.213727 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:02.224557 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:02.225063 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:02.225503 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:02.226256 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:02.226721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:02.227143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:02.319050 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7c53f818-738a-442a-8c42-4a6399617be8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:02.329676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7c53f818-738a-442a-8c42-4a6399617be8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.225777 Sep 08 14:01:02.330298 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 530/1052] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:02 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:02.388034 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:02.396651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:02.398168 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:02.399327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-95f78c9f-b55a-4f23-b454-69065570c4f8 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.190854 Sep 08 14:01:02.399918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 523/1053] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:02 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:01:03.355810 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e329dee1-e40a-4ca6-9c0a-679c95501ce0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:03.356871 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e329dee1-e40a-4ca6-9c0a-679c95501ce0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:03.366216 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e329dee1-e40a-4ca6-9c0a-679c95501ce0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:03.370556 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e329dee1-e40a-4ca6-9c0a-679c95501ce0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:03.371278 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e329dee1-e40a-4ca6-9c0a-679c95501ce0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:03.372186 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e329dee1-e40a-4ca6-9c0a-679c95501ce0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:03.374624 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e329dee1-e40a-4ca6-9c0a-679c95501ce0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:03.375272 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e329dee1-e40a-4ca6-9c0a-679c95501ce0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:03.425163 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:03.425800 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:03.433508 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:03.436471 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:03.439044 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:03.439976 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:03.440592 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:03.443423 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:03.782427 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e329dee1-e40a-4ca6-9c0a-679c95501ce0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:03.796290 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e329dee1-e40a-4ca6-9c0a-679c95501ce0 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.444939 Sep 08 14:01:03.797184 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 531/1054] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:03 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:03.811069 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:03.821891 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:03.826953 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:03.828371 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b52ddd97-f747-4da9-8b9c-68952c46ac5c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.407575 Sep 08 14:01:03.829086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 524/1055] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:03 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:01:04.824882 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2cb2b8cb-33f6-4fe5-ba79-258e3d212117 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:04.827460 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2cb2b8cb-33f6-4fe5-ba79-258e3d212117 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:04.830242 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:01:04.830385 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Thu Sep 8 14:01:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f (ip 10.222.0.55) !!! Sep 08 14:01:04.839536 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb2b8cb-33f6-4fe5-ba79-258e3d212117 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:04.841159 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb2b8cb-33f6-4fe5-ba79-258e3d212117 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:04.841678 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb2b8cb-33f6-4fe5-ba79-258e3d212117 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:04.842659 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb2b8cb-33f6-4fe5-ba79-258e3d212117 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:04.843653 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb2b8cb-33f6-4fe5-ba79-258e3d212117 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:04.844147 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2cb2b8cb-33f6-4fe5-ba79-258e3d212117 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:04.856591 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:04.858058 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:04.869522 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:04.870336 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:04.872621 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:04.873550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:04.878310 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:04.879768 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:04.922128 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:05.082351 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2cb2b8cb-33f6-4fe5-ba79-258e3d212117 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:05.095285 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2cb2b8cb-33f6-4fe5-ba79-258e3d212117 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.276609 Sep 08 14:01:05.111868 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 532/1056] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:04 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:05.132719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:05.141275 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:05.153842 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:05.155483 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3d57fa24-9a4e-4b02-a60d-154c57dd3aaf tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.303658 Sep 08 14:01:05.156105 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 525/1057] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:04 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:05.534115 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0793e745-183d-41ca-9914-d15c234dcb16 req-f1bcc20a-7df2-4f45-bca4-8902005a5984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0fbbab-644f-4d57-b4bf-644204a5b26f", "name": "network-vif-plugged", "status": "completed", "tag": "07945f23-93ca-4174-93c3-7352e02ec6a5"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:05.559541 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0793e745-183d-41ca-9914-d15c234dcb16 req-f1bcc20a-7df2-4f45-bca4-8902005a5984 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:05.560331 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0793e745-183d-41ca-9914-d15c234dcb16 req-f1bcc20a-7df2-4f45-bca4-8902005a5984 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:05.560976 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0793e745-183d-41ca-9914-d15c234dcb16 req-f1bcc20a-7df2-4f45-bca4-8902005a5984 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:05.591068 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0793e745-183d-41ca-9914-d15c234dcb16 req-f1bcc20a-7df2-4f45-bca4-8902005a5984 service nova] Creating event network-vif-plugged:07945f23-93ca-4174-93c3-7352e02ec6a5 for instance 6c0fbbab-644f-4d57-b4bf-644204a5b26f on hv-cinder-82002 Sep 08 14:01:05.600702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0793e745-183d-41ca-9914-d15c234dcb16 req-f1bcc20a-7df2-4f45-bca4-8902005a5984 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071145 Sep 08 14:01:05.601554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 533/1058] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:01:06.122608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dbd1f62d-338a-4746-bbfc-674f042d9448 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:06.123293 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dbd1f62d-338a-4746-bbfc-674f042d9448 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:06.130681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbd1f62d-338a-4746-bbfc-674f042d9448 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:06.131750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbd1f62d-338a-4746-bbfc-674f042d9448 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:06.132343 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbd1f62d-338a-4746-bbfc-674f042d9448 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:06.133204 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbd1f62d-338a-4746-bbfc-674f042d9448 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:06.133904 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbd1f62d-338a-4746-bbfc-674f042d9448 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:06.135151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dbd1f62d-338a-4746-bbfc-674f042d9448 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:06.188814 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:06.189516 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:06.198621 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:06.203048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:06.203720 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:06.206512 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:06.207204 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:06.209392 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:06.422816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-dbd1f62d-338a-4746-bbfc-674f042d9448 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:06.432708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dbd1f62d-338a-4746-bbfc-674f042d9448 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.315089 Sep 08 14:01:06.433877 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 526/1059] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:06 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:06.449009 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:06.458017 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:06.459424 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:06.460758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc46e05f-45da-466a-856e-33d15f93f85c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.276900 Sep 08 14:01:06.487665 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 534/1060] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:06 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:01:07.458903 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-74bf5c64-ae2b-4fc7-9d0a-0e7122f068b8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:07.459773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-74bf5c64-ae2b-4fc7-9d0a-0e7122f068b8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:07.468577 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bf5c64-ae2b-4fc7-9d0a-0e7122f068b8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:07.479085 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bf5c64-ae2b-4fc7-9d0a-0e7122f068b8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:07.479627 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bf5c64-ae2b-4fc7-9d0a-0e7122f068b8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:07.480397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bf5c64-ae2b-4fc7-9d0a-0e7122f068b8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:07.480862 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bf5c64-ae2b-4fc7-9d0a-0e7122f068b8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:07.481284 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-74bf5c64-ae2b-4fc7-9d0a-0e7122f068b8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:07.491352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:07.492120 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:07.509108 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:07.509598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:07.510090 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:07.510820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:07.511241 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:07.511664 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:07.773157 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:07.774954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-74bf5c64-ae2b-4fc7-9d0a-0e7122f068b8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:07.782858 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-74bf5c64-ae2b-4fc7-9d0a-0e7122f068b8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.328102 Sep 08 14:01:07.783418 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 527/1061] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:07 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:07.793226 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:07.795964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:07.797220 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-86677c2c-3bf4-4473-a040-752d61c09fcc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.309871 Sep 08 14:01:07.797867 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 535/1062] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:07 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:01:08.811508 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-df717ad1-2f5d-400f-b0b5-d17c9a8b0162 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:08.812556 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-df717ad1-2f5d-400f-b0b5-d17c9a8b0162 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:08.820123 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df717ad1-2f5d-400f-b0b5-d17c9a8b0162 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:08.820625 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df717ad1-2f5d-400f-b0b5-d17c9a8b0162 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:08.821036 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df717ad1-2f5d-400f-b0b5-d17c9a8b0162 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:08.821778 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df717ad1-2f5d-400f-b0b5-d17c9a8b0162 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:08.822393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df717ad1-2f5d-400f-b0b5-d17c9a8b0162 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:08.822810 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-df717ad1-2f5d-400f-b0b5-d17c9a8b0162 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:08.825280 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:08.826031 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:08.843840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:08.844451 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:08.845006 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:08.846013 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:08.846547 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:08.847056 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:08.864755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:09.016933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-df717ad1-2f5d-400f-b0b5-d17c9a8b0162 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:09.025289 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-df717ad1-2f5d-400f-b0b5-d17c9a8b0162 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.221229 Sep 08 14:01:09.025832 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 528/1063] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:08 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:09.048598 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:09.056935 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:09.058391 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:09.059540 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8509d5d6-c858-4aa5-97a1-423a4ceb1038 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.239775 Sep 08 14:01:09.060095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 536/1064] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:08 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:10.048227 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f7a2f20f-b68f-4501-87e7-59f7f80d91c5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:10.048881 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f7a2f20f-b68f-4501-87e7-59f7f80d91c5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:10.059310 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7a2f20f-b68f-4501-87e7-59f7f80d91c5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:10.059310 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7a2f20f-b68f-4501-87e7-59f7f80d91c5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:10.059310 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7a2f20f-b68f-4501-87e7-59f7f80d91c5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:10.059310 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7a2f20f-b68f-4501-87e7-59f7f80d91c5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:10.059676 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7a2f20f-b68f-4501-87e7-59f7f80d91c5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:10.059676 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f7a2f20f-b68f-4501-87e7-59f7f80d91c5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:10.084447 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:10.085145 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:10.098689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:10.099192 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:10.099624 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:10.100326 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:10.100808 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:10.101235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:10.244787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f7a2f20f-b68f-4501-87e7-59f7f80d91c5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:10.252585 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f7a2f20f-b68f-4501-87e7-59f7f80d91c5 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1265 microversion: 2.1 time: 0.208111 Sep 08 14:01:10.253155 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 529/1065] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:10 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:10.274060 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:10.282656 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:10.284126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:10.285356 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5f74fbdc-6e3a-4deb-b02f-177a99354e6d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.204869 Sep 08 14:01:10.285974 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 537/1066] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:10 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:01:11.277106 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-31680c92-1ac2-45d6-8897-64bd95117d02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:11.277836 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-31680c92-1ac2-45d6-8897-64bd95117d02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:11.284807 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31680c92-1ac2-45d6-8897-64bd95117d02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:11.285677 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31680c92-1ac2-45d6-8897-64bd95117d02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:11.286174 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31680c92-1ac2-45d6-8897-64bd95117d02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:11.287410 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31680c92-1ac2-45d6-8897-64bd95117d02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:11.288092 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31680c92-1ac2-45d6-8897-64bd95117d02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:11.288526 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-31680c92-1ac2-45d6-8897-64bd95117d02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:11.310917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:11.311477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:11.322290 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:11.323070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:11.323514 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:11.324363 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:11.326920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:11.327358 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:11.547329 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-31680c92-1ac2-45d6-8897-64bd95117d02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:11.551903 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:11.558481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-31680c92-1ac2-45d6-8897-64bd95117d02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1452 microversion: 2.1 time: 0.286438 Sep 08 14:01:11.559069 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 530/1067] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:11 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1452 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:11.564680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:11.566202 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:11.567436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-2da0015c-82a7-4bf0-a564-0f721c28b11d tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.260491 Sep 08 14:01:11.568146 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 538/1068] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:11 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:11.580214 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01e0547f-bca8-4248-b4dd-8984c07e7511 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:11.580837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-01e0547f-bca8-4248-b4dd-8984c07e7511 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:11.586697 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e0547f-bca8-4248-b4dd-8984c07e7511 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:11.587699 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e0547f-bca8-4248-b4dd-8984c07e7511 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:11.588161 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e0547f-bca8-4248-b4dd-8984c07e7511 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:11.588858 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e0547f-bca8-4248-b4dd-8984c07e7511 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:11.589317 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e0547f-bca8-4248-b4dd-8984c07e7511 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:11.589792 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01e0547f-bca8-4248-b4dd-8984c07e7511 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:11.726709 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-01e0547f-bca8-4248-b4dd-8984c07e7511 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:11.734519 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-01e0547f-bca8-4248-b4dd-8984c07e7511 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1452 microversion: 2.1 time: 0.157985 Sep 08 14:01:11.735083 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 531/1069] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:11 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:12.595126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:12.596796 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:12.605772 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:12.606325 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:12.606949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:12.607676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:12.608132 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:12.609141 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:12.867790 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:12.877387 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:12.879861 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:12.881452 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a84128b0-8c7c-4a65-a039-83aca26263b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.292772 Sep 08 14:01:12.894295 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 539/1070] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:12 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:13.497671 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3aa4e31b-3d64-441f-b291-d316d45065e2 req-c9016a1a-d345-4454-85bf-d6cc6e4b07f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3625263b-e16f-4c5c-a20a-591dca9ca140", "name": "network-vif-plugged", "status": "completed", "tag": "daea8158-0875-402f-9603-ddb321067a70"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:13.524813 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3aa4e31b-3d64-441f-b291-d316d45065e2 req-c9016a1a-d345-4454-85bf-d6cc6e4b07f4 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:13.525405 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3aa4e31b-3d64-441f-b291-d316d45065e2 req-c9016a1a-d345-4454-85bf-d6cc6e4b07f4 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:13.525929 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3aa4e31b-3d64-441f-b291-d316d45065e2 req-c9016a1a-d345-4454-85bf-d6cc6e4b07f4 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:13.543118 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-3aa4e31b-3d64-441f-b291-d316d45065e2 req-c9016a1a-d345-4454-85bf-d6cc6e4b07f4 service nova] Creating event network-vif-plugged:daea8158-0875-402f-9603-ddb321067a70 for instance 3625263b-e16f-4c5c-a20a-591dca9ca140 on hv-cinder-82002 Sep 08 14:01:13.549597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3aa4e31b-3d64-441f-b291-d316d45065e2 req-c9016a1a-d345-4454-85bf-d6cc6e4b07f4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059980 Sep 08 14:01:13.551845 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 532/1071] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:13.596228 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-a7ec1b64-507b-4361-b9bc-770402beb286 req-4401c91e-3bb7-4846-af1e-6a127cbe4432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0fbbab-644f-4d57-b4bf-644204a5b26f", "tag": "07945f23-93ca-4174-93c3-7352e02ec6a5"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:13.607071 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a7ec1b64-507b-4361-b9bc-770402beb286 req-4401c91e-3bb7-4846-af1e-6a127cbe4432 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:13.607553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a7ec1b64-507b-4361-b9bc-770402beb286 req-4401c91e-3bb7-4846-af1e-6a127cbe4432 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:13.608121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-a7ec1b64-507b-4361-b9bc-770402beb286 req-4401c91e-3bb7-4846-af1e-6a127cbe4432 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:13.624672 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-a7ec1b64-507b-4361-b9bc-770402beb286 req-4401c91e-3bb7-4846-af1e-6a127cbe4432 service nova] Creating event network-changed:07945f23-93ca-4174-93c3-7352e02ec6a5 for instance 6c0fbbab-644f-4d57-b4bf-644204a5b26f on hv-cinder-82002 Sep 08 14:01:13.630144 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-a7ec1b64-507b-4361-b9bc-770402beb286 req-4401c91e-3bb7-4846-af1e-6a127cbe4432 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037460 Sep 08 14:01:13.635340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 540/1072] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:13.914475 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:13.915753 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:13.922495 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:13.922990 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:13.923429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:13.924143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:13.924595 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:13.925019 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:14.402803 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:14.411075 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:14.412761 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:14.414067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f5f25ff9-b3be-4b30-973a-ddba5ae51d89 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.504007 Sep 08 14:01:14.430116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 533/1073] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:13 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:15.441208 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:15.442043 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:15.449509 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:15.450096 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:15.450596 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:15.451353 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:15.452033 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:15.452514 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:15.588382 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:15.596590 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:15.598029 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:15.599168 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e765355e-1966-434e-9552-07c2fe2271aa tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.162694 Sep 08 14:01:15.599719 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 541/1074] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:15 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:01:16.625551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:16.626215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:16.632847 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:16.633266 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:16.634251 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:16.634943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:16.635397 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:16.635816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:16.769796 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:16.777806 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:16.779242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:16.780403 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-05593b0e-8a65-4a39-8df2-29fa6c1f2a44 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.159314 Sep 08 14:01:16.780965 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 534/1075] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:16 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:17.806014 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:17.806633 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:17.813076 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:17.813554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:17.814018 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:17.814707 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:17.815155 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:17.815576 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:17.944688 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:17.952774 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:17.954235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:17.955375 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-22f9b96a-473d-41d8-bd84-a09aca442577 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.153821 Sep 08 14:01:17.955928 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 542/1076] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:17 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:18.980344 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:18.980953 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:18.987440 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:18.987920 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:18.988354 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:18.989042 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:18.989487 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:18.989969 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:19.120534 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:19.128570 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:19.130054 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:19.131210 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1c92590e-6eba-4355-8a42-de9b4d166cda tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.154737 Sep 08 14:01:19.131778 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 535/1077] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:18 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:20.155809 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:20.156449 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:20.162902 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:20.163465 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:20.163900 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:20.164589 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:20.165263 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:20.165443 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:20.295639 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:20.303629 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:20.305057 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:20.307393 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-66ae3418-2152-446e-b96c-a5a4783dd3bc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.155324 Sep 08 14:01:20.308244 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 543/1078] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:20 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:21.333311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:21.333945 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:21.340567 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:21.341087 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:21.341502 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:21.342215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:21.342660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:21.343078 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:21.492222 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:21.500715 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:21.502172 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:21.503311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ca601d48-c64c-4115-af18-ced8bdc363d1 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1732 microversion: 2.20 time: 0.173762 Sep 08 14:01:21.503862 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 536/1079] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:21 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:01:22.529865 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:22.530555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:22.538814 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:22.539306 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:22.540309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:22.541019 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:22.541476 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:22.541933 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:22.683036 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:22.693588 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:22.695050 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:22.696230 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0962510a-b665-45fa-b014-a863706aab86 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1719 microversion: 2.20 time: 0.172162 Sep 08 14:01:22.696777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 544/1080] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:01:22 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:10.833484 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a8c78fba-0af2-4bf5-b072-939a89140ee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:10.835809 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a8c78fba-0af2-4bf5-b072-939a89140ee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:10.838047 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=38 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:10.838692 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=64 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:10.845158 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8c78fba-0af2-4bf5-b072-939a89140ee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.845633 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8c78fba-0af2-4bf5-b072-939a89140ee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.846086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8c78fba-0af2-4bf5-b072-939a89140ee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.846773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8c78fba-0af2-4bf5-b072-939a89140ee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.847217 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8c78fba-0af2-4bf5-b072-939a89140ee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.847639 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a8c78fba-0af2-4bf5-b072-939a89140ee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.877377 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a8c78fba-0af2-4bf5-b072-939a89140ee3 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048003 Sep 08 14:02:10.877950 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 537/1081] 10.222.0.55 () {60 vars in 1343 bytes} [Thu Sep 8 14:02:10 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:10.942766 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-848b7094-59d9-4ba5-a7d0-4a7ed2a1de67 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:10.943340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-848b7094-59d9-4ba5-a7d0-4a7ed2a1de67 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:10.945499 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=31 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:10.946158 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=47 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:10.952392 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848b7094-59d9-4ba5-a7d0-4a7ed2a1de67 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.952985 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848b7094-59d9-4ba5-a7d0-4a7ed2a1de67 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.953627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848b7094-59d9-4ba5-a7d0-4a7ed2a1de67 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.954363 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848b7094-59d9-4ba5-a7d0-4a7ed2a1de67 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.954810 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848b7094-59d9-4ba5-a7d0-4a7ed2a1de67 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.955311 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-848b7094-59d9-4ba5-a7d0-4a7ed2a1de67 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.980431 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-848b7094-59d9-4ba5-a7d0-4a7ed2a1de67 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:02:11.055867 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-848b7094-59d9-4ba5-a7d0-4a7ed2a1de67 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 204 len: 0 microversion: 2.20 time: 0.116780 Sep 08 14:02:11.056333 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 545/1082] 10.222.0.55 () {60 vars in 1280 bytes} [Thu Sep 8 14:02:10 2022] DELETE /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 14:02:11.065905 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:11.066542 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:11.072907 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.073378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.073862 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.074546 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.074991 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.075405 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.209116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:11.217412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:11.218956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:11.220116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d8d251ae-1f8b-4d58-b085-76aac2e7b939 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.158247 Sep 08 14:02:11.220672 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 538/1083] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:11 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:12.245712 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:12.246418 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:12.252661 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:12.253130 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:12.253550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:12.254252 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:12.254695 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:12.255106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:12.385453 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.393531 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.395035 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.396234 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4e376ab0-09cd-479d-9c92-6179370664b6 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.154854 Sep 08 14:02:12.396818 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 546/1084] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:12 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:13.422102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:13.422708 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:13.429028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.429596 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.430063 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.430748 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.431212 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.431609 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.557970 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:13.566501 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:13.568032 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:13.569172 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3c6dc09e-28e5-4f8b-ad58-aaf1e413b22f tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.150979 Sep 08 14:02:13.569747 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 539/1085] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:13 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:14.595963 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:14.596573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:14.603317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.603790 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.604213 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.604917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.605357 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.605791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.737992 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:14.745927 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:14.747340 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:14.748483 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-8f65be48-df36-4dee-b70b-b47e3a7d50b2 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.156350 Sep 08 14:02:14.749056 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 547/1086] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:14 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:15.774734 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:15.775343 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:15.781643 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.782240 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.782682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.783378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.783830 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.784370 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.037105 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:16.046774 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:16.048439 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75642df28f5d4301b979f39482a9a11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4476b1f4b84b5593ff2650592b9fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:16.049807 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-cface7e1-1f62-4f48-af43-ea0e55a3aa2c tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 200 len: 1725 microversion: 2.20 time: 0.278938 Sep 08 14:02:16.050440 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 540/1087] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:15 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:02:16.270577 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-f532cbe6-6b57-4230-b349-f8ed40555e06 req-8a80bc26-ef72-4d30-8c6e-bdb64f3e97e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3625263b-e16f-4c5c-a20a-591dca9ca140", "name": "network-vif-deleted", "tag": "daea8158-0875-402f-9603-ddb321067a70"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:16.281834 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f532cbe6-6b57-4230-b349-f8ed40555e06 req-8a80bc26-ef72-4d30-8c6e-bdb64f3e97e0 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.282313 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f532cbe6-6b57-4230-b349-f8ed40555e06 req-8a80bc26-ef72-4d30-8c6e-bdb64f3e97e0 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.282885 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-f532cbe6-6b57-4230-b349-f8ed40555e06 req-8a80bc26-ef72-4d30-8c6e-bdb64f3e97e0 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.296662 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-f532cbe6-6b57-4230-b349-f8ed40555e06 req-8a80bc26-ef72-4d30-8c6e-bdb64f3e97e0 service nova] Creating event network-vif-deleted:daea8158-0875-402f-9603-ddb321067a70 for instance 3625263b-e16f-4c5c-a20a-591dca9ca140 on hv-cinder-82002 Sep 08 14:02:16.301873 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-f532cbe6-6b57-4230-b349-f8ed40555e06 req-8a80bc26-ef72-4d30-8c6e-bdb64f3e97e0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038102 Sep 08 14:02:16.305999 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 548/1088] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:02:17.075556 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:17.076273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:17.082998 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.083886 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.084670 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.085434 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.085936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.086360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.101440 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] HTTP exception thrown: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Request method failure captured: Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 HTTP/1.1 Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfQFq92kMrVdozthbOpEzsVUQ43Buu-GQ_wTr90qCRDohg2vORztK0wwVACNzVXag0PWbJnt4G_rvrQGd2XexDY6I4EyntzorjlzdlqX2dKQdVHXtRXnYN44qlWJt80te1GvIdIgXbsW_FJkgITDjO3kPYbzdg5K3yw0A9SjswplHR4 Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:02:17.103130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bc4476b1f4b84b5593ff2650592b9fb7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 75642df28f5d4301b979f39482a9a11d Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:17.105433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '3625263b-e16f-4c5c-a20a-591dca9ca140'} Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:02:17.106311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:17.107651 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:17.109577 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Returning 404 to user: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:02:17.109577 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-be735e80-4212-4a2e-846a-7b3d28071cd0 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 404 len: 111 microversion: 2.20 time: 0.033458 Sep 08 14:02:17.109577 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 541/1089] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:17 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:02:17.118238 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-946ab525-926e-4e53-aa6a-494c81bbc567 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '.version_select at 0x7f5be471ad30>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:17.141990 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-946ab525-926e-4e53-aa6a-494c81bbc567 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458308407" status: 204 len: 0 microversion: 2.20 time: 0.028350 Sep 08 14:02:17.143212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 549/1090] 10.222.0.55 () {60 vars in 1262 bytes} [Thu Sep 8 14:02:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458308407 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 14:02:19.013375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:19.013969 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:19.020661 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.021218 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.021669 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.022468 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.022913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.023330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.037414 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] HTTP exception thrown: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Request method failure captured: Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 HTTP/1.1 Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfQFq92kMrVdozthbOpEzsVUQ43Buu-GQ_wTr90qCRDohg2vORztK0wwVACNzVXag0PWbJnt4G_rvrQGd2XexDY6I4EyntzorjlzdlqX2dKQdVHXtRXnYN44qlWJt80te1GvIdIgXbsW_FJkgITDjO3kPYbzdg5K3yw0A9SjswplHR4 Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:02:19.039037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bc4476b1f4b84b5593ff2650592b9fb7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 75642df28f5d4301b979f39482a9a11d Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:19.041294 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '3625263b-e16f-4c5c-a20a-591dca9ca140'} Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:02:19.042243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:19.043789 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:19.045290 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Returning 404 to user: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:02:19.045290 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-10e7e3a7-1112-4da8-8ad9-838fbc257f79 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 404 len: 111 microversion: 2.20 time: 0.032025 Sep 08 14:02:19.045290 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 542/1091] 10.222.0.55 () {60 vars in 1280 bytes} [Thu Sep 8 14:02:19 2022] DELETE /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:02:19.053831 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:19.054616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: 3625263b-e16f-4c5c-a20a-591dca9ca140] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:19.062179 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.062705 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.063141 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.063917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.064317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.064737 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.079963 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] HTTP exception thrown: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Request method failure captured: Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 HTTP/1.1 Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfQFq92kMrVdozthbOpEzsVUQ43Buu-GQ_wTr90qCRDohg2vORztK0wwVACNzVXag0PWbJnt4G_rvrQGd2XexDY6I4EyntzorjlzdlqX2dKQdVHXtRXnYN44qlWJt80te1GvIdIgXbsW_FJkgITDjO3kPYbzdg5K3yw0A9SjswplHR4 Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:02:19.081649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bc4476b1f4b84b5593ff2650592b9fb7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 75642df28f5d4301b979f39482a9a11d Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:19.083430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '3625263b-e16f-4c5c-a20a-591dca9ca140'} Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:02:19.084612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. Sep 08 14:02:19.086820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:02:19.089322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Returning 404 to user: Instance 3625263b-e16f-4c5c-a20a-591dca9ca140 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:02:19.089322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ea498725-2281-47df-8f26-cc2ba4694221 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140" status: 404 len: 111 microversion: 2.20 time: 0.033345 Sep 08 14:02:19.089322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 550/1092] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:19 2022] GET /compute/v2.1/servers/3625263b-e16f-4c5c-a20a-591dca9ca140 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:02:20.237713 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:20.238286 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:20.245783 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.246393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.246837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.247699 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.248248 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.248674 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.263852 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] HTTP exception thrown: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Request method failure captured: Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 HTTP/1.1 Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfQFq92kMrVdozthbOpEzsVUQ43Buu-GQ_wTr90qCRDohg2vORztK0wwVACNzVXag0PWbJnt4G_rvrQGd2XexDY6I4EyntzorjlzdlqX2dKQdVHXtRXnYN44qlWJt80te1GvIdIgXbsW_FJkgITDjO3kPYbzdg5K3yw0A9SjswplHR4 Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:02:20.265435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bc4476b1f4b84b5593ff2650592b9fb7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 75642df28f5d4301b979f39482a9a11d Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 14:02:20.267558 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': 'efdb4c65-ed8d-4792-ac96-8b1053b167b5'} Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:02:20.268954 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 14:02:20.270829 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:20.272429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Returning 404 to user: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:02:20.272429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-09a746a6-ddce-4b1d-942b-ba22ca9369dc tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "DELETE /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 404 len: 111 microversion: 2.20 time: 0.034218 Sep 08 14:02:20.272429 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 543/1093] 10.222.0.55 () {60 vars in 1280 bytes} [Thu Sep 8 14:02:20 2022] DELETE /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:02:20.278146 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:20.278782 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] [instance: efdb4c65-ed8d-4792-ac96-8b1053b167b5] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:20.284745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.285219 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.285644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.301676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.301676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.301676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.308473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] HTTP exception thrown: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Request method failure captured: Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 HTTP/1.1 Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfQFq92kMrVdozthbOpEzsVUQ43Buu-GQ_wTr90qCRDohg2vORztK0wwVACNzVXag0PWbJnt4G_rvrQGd2XexDY6I4EyntzorjlzdlqX2dKQdVHXtRXnYN44qlWJt80te1GvIdIgXbsW_FJkgITDjO3kPYbzdg5K3yw0A9SjswplHR4 Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:02:20.310372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bc4476b1f4b84b5593ff2650592b9fb7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bc4476b1f4b84b5593ff2650592b9fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: bc4476b1f4b84b5593ff2650592b9fb7 Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1913986753 Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 75642df28f5d4301b979f39482a9a11d Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1913986753-project Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 14:02:20.312114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': 'efdb4c65-ed8d-4792-ac96-8b1053b167b5'} Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:02:20.312979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. Sep 08 14:02:20.314802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:02:20.316243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] Returning 404 to user: Instance efdb4c65-ed8d-4792-ac96-8b1053b167b5 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:02:20.316243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-10461aeb-5d65-41a6-aa17-b6f8c917c392 tempest-AttachVolumeShelveTestJSON-1913986753 tempest-AttachVolumeShelveTestJSON-1913986753-project] 10.222.0.55 "GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5" status: 404 len: 111 microversion: 2.20 time: 0.037843 Sep 08 14:02:20.316243 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 551/1094] 10.222.0.55 () {60 vars in 1277 bytes} [Thu Sep 8 14:02:20 2022] GET /compute/v2.1/servers/efdb4c65-ed8d-4792-ac96-8b1053b167b5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:02:38.890946 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=14 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:38.891664 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=30 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:39.063342 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9c46c073-3c73-4c08-a61e-6571c929a9e4 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Action: 'create', calling method: .version_select at 0x7f5be45a3430>, body: {"keypair": {"name": "tempest-TestShelveInstance-336262040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7hyZlqUIBO08QKUR+x3ExAcHEdYTjncs4imqVbfr+6ifcejG/liG1gTSQX3NWoSGtJoYcK6tVVqRba590SEFr96I+wG7shw560qTDRLZD8m0JDlxKCtabv3sMj+q3k3g=="}} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:39.079426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-9c46c073-3c73-4c08-a61e-6571c929a9e4 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Getting quotas for project 1dcae1b090af440f836b18a7bb000c27. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:02:39.083473 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.quota [None req-9c46c073-3c73-4c08-a61e-6571c929a9e4 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Getting quotas for user 39393f5448ed4c489ae1459d251f50d0 and project 1dcae1b090af440f836b18a7bb000c27. Resources: {'key_pairs'} {{(pid=126920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:02:39.108463 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9c46c073-3c73-4c08-a61e-6571c929a9e4 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.222200 Sep 08 14:02:39.109376 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 544/1095] 10.222.0.55 () {60 vars in 1159 bytes} [Thu Sep 8 14:02:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:44.438461 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-725507802", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "networks": [{"uuid": "95015f11-4506-4483-bc8b-0d6bce5985db"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:44.450326 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:44.451096 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:44.684024 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] validate_networks() for [('95015f11-4506-4483-bc8b-0d6bce5985db', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:02:45.108412 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:02:45.108826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:02:45.109337 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:02:45.109799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:02:45.110160 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:02:45.124484 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.125367 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.125994 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.126940 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.127385 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.127800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.146494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Getting quotas for project 6a848414c86b439c922442d0862c334f. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:02:45.150847 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Getting quotas for user 52bda0133af44d5ca220ba869fbcb3a9 and project 6a848414c86b439c922442d0862c334f. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:02:45.162043 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:02:45.164421 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:02:45.218245 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3ac1634a-72ec-46e8-962c-0cc28649e09a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783516 Sep 08 14:02:45.218886 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 552/1096] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 14:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:02:45.231465 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ff0a2a6b-62f8-49b8-897b-08372d798fe8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:45.232094 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ff0a2a6b-62f8-49b8-897b-08372d798fe8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:45.497123 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ff0a2a6b-62f8-49b8-897b-08372d798fe8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:45.517141 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ff0a2a6b-62f8-49b8-897b-08372d798fe8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1213 microversion: 2.1 time: 0.290869 Sep 08 14:02:45.518076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 545/1097] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:45 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1213 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:46.540868 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-900e7260-9073-40e7-81c6-4dc203b8b195 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:46.541665 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-900e7260-9073-40e7-81c6-4dc203b8b195 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:46.553036 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e7260-9073-40e7-81c6-4dc203b8b195 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.553954 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e7260-9073-40e7-81c6-4dc203b8b195 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.554799 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e7260-9073-40e7-81c6-4dc203b8b195 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.556267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e7260-9073-40e7-81c6-4dc203b8b195 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.556825 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e7260-9073-40e7-81c6-4dc203b8b195 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.557640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-900e7260-9073-40e7-81c6-4dc203b8b195 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.667206 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-900e7260-9073-40e7-81c6-4dc203b8b195 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:46.676378 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-900e7260-9073-40e7-81c6-4dc203b8b195 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1273 microversion: 2.1 time: 0.139939 Sep 08 14:02:46.677096 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 553/1098] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:46 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:47.700681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e9c24c56-5c9d-4495-b860-c3175f8e4808 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:47.701714 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e9c24c56-5c9d-4495-b860-c3175f8e4808 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:47.711113 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9c24c56-5c9d-4495-b860-c3175f8e4808 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.711728 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9c24c56-5c9d-4495-b860-c3175f8e4808 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.712237 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9c24c56-5c9d-4495-b860-c3175f8e4808 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.713034 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9c24c56-5c9d-4495-b860-c3175f8e4808 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.713491 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9c24c56-5c9d-4495-b860-c3175f8e4808 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.713957 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e9c24c56-5c9d-4495-b860-c3175f8e4808 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.931503 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e9c24c56-5c9d-4495-b860-c3175f8e4808 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:47.940684 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e9c24c56-5c9d-4495-b860-c3175f8e4808 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1313 microversion: 2.1 time: 0.243702 Sep 08 14:02:47.942077 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 546/1099] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:47 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:48.072248 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-9bf48092-8655-42ba-93fa-8de48f94d996 req-c2689714-8db2-4a89-b76b-071f21e82ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730cfd15-29b6-4857-8e2f-a6bf8fc52ec4", "tag": "e160d3df-0f22-4811-abc5-6838a5194ecd"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:48.084739 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9bf48092-8655-42ba-93fa-8de48f94d996 req-c2689714-8db2-4a89-b76b-071f21e82ab8 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:48.085594 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9bf48092-8655-42ba-93fa-8de48f94d996 req-c2689714-8db2-4a89-b76b-071f21e82ab8 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:48.086183 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-9bf48092-8655-42ba-93fa-8de48f94d996 req-c2689714-8db2-4a89-b76b-071f21e82ab8 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:48.100825 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-9bf48092-8655-42ba-93fa-8de48f94d996 req-c2689714-8db2-4a89-b76b-071f21e82ab8 service nova] Creating event network-changed:e160d3df-0f22-4811-abc5-6838a5194ecd for instance 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 on hv-cinder-82002 Sep 08 14:02:48.106603 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-9bf48092-8655-42ba-93fa-8de48f94d996 req-c2689714-8db2-4a89-b76b-071f21e82ab8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042943 Sep 08 14:02:48.107716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 554/1100] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:48.968471 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-870e0392-e73c-4825-b719-26ae5e51e1c0 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:48.969089 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-870e0392-e73c-4825-b719-26ae5e51e1c0 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:48.975939 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-870e0392-e73c-4825-b719-26ae5e51e1c0 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:48.976424 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-870e0392-e73c-4825-b719-26ae5e51e1c0 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:48.976865 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-870e0392-e73c-4825-b719-26ae5e51e1c0 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:48.978197 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-870e0392-e73c-4825-b719-26ae5e51e1c0 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:48.978654 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-870e0392-e73c-4825-b719-26ae5e51e1c0 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:48.979078 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-870e0392-e73c-4825-b719-26ae5e51e1c0 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:49.114927 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-870e0392-e73c-4825-b719-26ae5e51e1c0 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:49.122690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-870e0392-e73c-4825-b719-26ae5e51e1c0 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1313 microversion: 2.1 time: 0.158504 Sep 08 14:02:49.123326 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 547/1101] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:48 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:50.148234 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-d4057604-8b5e-480b-a6ae-6791516ee7e7 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:50.148940 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-d4057604-8b5e-480b-a6ae-6791516ee7e7 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:50.156275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4057604-8b5e-480b-a6ae-6791516ee7e7 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:50.156761 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4057604-8b5e-480b-a6ae-6791516ee7e7 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:50.157193 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4057604-8b5e-480b-a6ae-6791516ee7e7 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:50.157925 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4057604-8b5e-480b-a6ae-6791516ee7e7 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:50.158380 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4057604-8b5e-480b-a6ae-6791516ee7e7 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:50.158801 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-d4057604-8b5e-480b-a6ae-6791516ee7e7 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:50.380299 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-d4057604-8b5e-480b-a6ae-6791516ee7e7 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:50.387936 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-d4057604-8b5e-480b-a6ae-6791516ee7e7 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1313 microversion: 2.1 time: 0.245482 Sep 08 14:02:50.388499 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 555/1102] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:50 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:51.411059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-949516cb-2027-473e-9c12-d4f06f845bdb tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:51.411673 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-949516cb-2027-473e-9c12-d4f06f845bdb tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:51.419590 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-949516cb-2027-473e-9c12-d4f06f845bdb tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:51.420035 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-949516cb-2027-473e-9c12-d4f06f845bdb tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:51.420467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-949516cb-2027-473e-9c12-d4f06f845bdb tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:51.421151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-949516cb-2027-473e-9c12-d4f06f845bdb tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:51.421601 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-949516cb-2027-473e-9c12-d4f06f845bdb tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:51.422053 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-949516cb-2027-473e-9c12-d4f06f845bdb tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:51.562071 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-949516cb-2027-473e-9c12-d4f06f845bdb tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:51.569635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-949516cb-2027-473e-9c12-d4f06f845bdb tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1313 microversion: 2.1 time: 0.162388 Sep 08 14:02:51.570220 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 548/1103] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:51 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:52.593111 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9df54d74-9793-4514-8e9c-fde5c5a2651d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:52.594316 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9df54d74-9793-4514-8e9c-fde5c5a2651d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:52.600533 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9df54d74-9793-4514-8e9c-fde5c5a2651d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:52.601018 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9df54d74-9793-4514-8e9c-fde5c5a2651d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:52.601451 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9df54d74-9793-4514-8e9c-fde5c5a2651d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:52.602176 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9df54d74-9793-4514-8e9c-fde5c5a2651d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:52.602635 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9df54d74-9793-4514-8e9c-fde5c5a2651d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:52.603055 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9df54d74-9793-4514-8e9c-fde5c5a2651d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:52.757206 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-789f0087-2b4d-4500-b3ad-069e3830c41c req-682b8cc0-14b2-4ed5-a3ad-2c6c6809b765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730cfd15-29b6-4857-8e2f-a6bf8fc52ec4", "name": "network-vif-plugged", "status": "completed", "tag": "e160d3df-0f22-4811-abc5-6838a5194ecd"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:52.769203 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-789f0087-2b4d-4500-b3ad-069e3830c41c req-682b8cc0-14b2-4ed5-a3ad-2c6c6809b765 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:52.769683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-789f0087-2b4d-4500-b3ad-069e3830c41c req-682b8cc0-14b2-4ed5-a3ad-2c6c6809b765 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:52.770390 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-789f0087-2b4d-4500-b3ad-069e3830c41c req-682b8cc0-14b2-4ed5-a3ad-2c6c6809b765 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:52.771942 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9df54d74-9793-4514-8e9c-fde5c5a2651d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:52.784597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-789f0087-2b4d-4500-b3ad-069e3830c41c req-682b8cc0-14b2-4ed5-a3ad-2c6c6809b765 service nova] Creating event network-vif-plugged:e160d3df-0f22-4811-abc5-6838a5194ecd for instance 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 on hv-cinder-82002 Sep 08 14:02:52.788713 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9df54d74-9793-4514-8e9c-fde5c5a2651d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1313 microversion: 2.1 time: 0.198429 Sep 08 14:02:52.791286 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-789f0087-2b4d-4500-b3ad-069e3830c41c req-682b8cc0-14b2-4ed5-a3ad-2c6c6809b765 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037861 Sep 08 14:02:52.791877 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 549/1104] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:02:52.799372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 556/1105] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:52 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:53.812631 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-57bc13ca-a80c-4549-97f9-50b7fa7e3c31 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:53.813338 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-57bc13ca-a80c-4549-97f9-50b7fa7e3c31 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:53.819909 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc13ca-a80c-4549-97f9-50b7fa7e3c31 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:53.820395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc13ca-a80c-4549-97f9-50b7fa7e3c31 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:53.821333 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc13ca-a80c-4549-97f9-50b7fa7e3c31 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:53.822051 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc13ca-a80c-4549-97f9-50b7fa7e3c31 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:53.822704 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc13ca-a80c-4549-97f9-50b7fa7e3c31 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:53.823119 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-57bc13ca-a80c-4549-97f9-50b7fa7e3c31 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:53.997986 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-57bc13ca-a80c-4549-97f9-50b7fa7e3c31 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:54.006936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-57bc13ca-a80c-4549-97f9-50b7fa7e3c31 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1313 microversion: 2.1 time: 0.198322 Sep 08 14:02:54.021167 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 550/1106] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:53 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:55.032213 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-92ade52a-bb6b-4572-a429-45ef6ae2656c tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:55.032824 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-92ade52a-bb6b-4572-a429-45ef6ae2656c tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:55.039287 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ade52a-bb6b-4572-a429-45ef6ae2656c tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:55.040302 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ade52a-bb6b-4572-a429-45ef6ae2656c tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:55.040737 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ade52a-bb6b-4572-a429-45ef6ae2656c tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:55.041485 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ade52a-bb6b-4572-a429-45ef6ae2656c tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:55.041962 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ade52a-bb6b-4572-a429-45ef6ae2656c tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:55.042552 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-92ade52a-bb6b-4572-a429-45ef6ae2656c tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:55.136904 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:55.157785 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=6 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:55.175461 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-92ade52a-bb6b-4572-a429-45ef6ae2656c tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:55.183114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-92ade52a-bb6b-4572-a429-45ef6ae2656c tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1497 microversion: 2.1 time: 0.154738 Sep 08 14:02:55.183836 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 557/1107] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:55 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:55.829799 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7d52717c-aac6-4057-85d9-ef00d425053a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:55.830326 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d52717c-aac6-4057-85d9-ef00d425053a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:55.832750 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=6 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:55.838353 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d52717c-aac6-4057-85d9-ef00d425053a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:55.838832 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d52717c-aac6-4057-85d9-ef00d425053a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:55.839259 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d52717c-aac6-4057-85d9-ef00d425053a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:55.839946 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d52717c-aac6-4057-85d9-ef00d425053a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:55.840653 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d52717c-aac6-4057-85d9-ef00d425053a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:55.841073 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d52717c-aac6-4057-85d9-ef00d425053a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:55.866846 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d52717c-aac6-4057-85d9-ef00d425053a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:02:55.941685 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7d52717c-aac6-4057-85d9-ef00d425053a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "DELETE /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 204 len: 0 microversion: 2.1 time: 0.115055 Sep 08 14:02:55.942463 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 551/1108] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:02:55 2022] DELETE /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:02:55.950925 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-760b340e-c400-4652-bfd6-871659f3658f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:55.951540 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-760b340e-c400-4652-bfd6-871659f3658f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:55.957494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-760b340e-c400-4652-bfd6-871659f3658f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:55.958002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-760b340e-c400-4652-bfd6-871659f3658f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:55.958428 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-760b340e-c400-4652-bfd6-871659f3658f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:55.959117 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-760b340e-c400-4652-bfd6-871659f3658f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:55.959568 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-760b340e-c400-4652-bfd6-871659f3658f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:55.959991 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-760b340e-c400-4652-bfd6-871659f3658f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:56.089771 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-760b340e-c400-4652-bfd6-871659f3658f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:56.097679 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-760b340e-c400-4652-bfd6-871659f3658f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1503 microversion: 2.1 time: 0.150626 Sep 08 14:02:56.098271 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 558/1109] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:55 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:57.121448 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4df39e8c-ae1f-4236-bb59-ac1a30e75c55 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:57.122277 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4df39e8c-ae1f-4236-bb59-ac1a30e75c55 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:57.128713 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df39e8c-ae1f-4236-bb59-ac1a30e75c55 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:57.129273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df39e8c-ae1f-4236-bb59-ac1a30e75c55 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:57.129717 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df39e8c-ae1f-4236-bb59-ac1a30e75c55 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:57.130437 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df39e8c-ae1f-4236-bb59-ac1a30e75c55 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:57.130894 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df39e8c-ae1f-4236-bb59-ac1a30e75c55 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:57.131318 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4df39e8c-ae1f-4236-bb59-ac1a30e75c55 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:57.283056 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4df39e8c-ae1f-4236-bb59-ac1a30e75c55 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:57.292065 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4df39e8c-ae1f-4236-bb59-ac1a30e75c55 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1503 microversion: 2.1 time: 0.175374 Sep 08 14:02:57.302344 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 552/1110] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:57 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:58.144743 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-0d6562ce-2e4a-4729-8b90-52c6ccca85d8 req-0bd57fe8-19ed-4da9-8d9d-6e1874773e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730cfd15-29b6-4857-8e2f-a6bf8fc52ec4", "name": "network-vif-deleted", "tag": "e160d3df-0f22-4811-abc5-6838a5194ecd"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:58.155551 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0d6562ce-2e4a-4729-8b90-52c6ccca85d8 req-0bd57fe8-19ed-4da9-8d9d-6e1874773e96 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:58.156022 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0d6562ce-2e4a-4729-8b90-52c6ccca85d8 req-0bd57fe8-19ed-4da9-8d9d-6e1874773e96 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:58.156446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-0d6562ce-2e4a-4729-8b90-52c6ccca85d8 req-0bd57fe8-19ed-4da9-8d9d-6e1874773e96 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:58.167834 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-0d6562ce-2e4a-4729-8b90-52c6ccca85d8 req-0bd57fe8-19ed-4da9-8d9d-6e1874773e96 service nova] Creating event network-vif-deleted:e160d3df-0f22-4811-abc5-6838a5194ecd for instance 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 on hv-cinder-82002 Sep 08 14:02:58.172457 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-0d6562ce-2e4a-4729-8b90-52c6ccca85d8 req-0bd57fe8-19ed-4da9-8d9d-6e1874773e96 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031371 Sep 08 14:02:58.173184 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 559/1111] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:58.317657 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:58.318977 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:58.326906 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:58.327398 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:58.327838 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:58.328710 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:58.329354 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:58.330172 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:58.363724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:58.364215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:58.364641 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:58.365093 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lazy-loading 'fault' on Instance uuid 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:02:58.418448 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:58.426298 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1b3f0d3d-9461-4084-81e2-f84b17131e50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 200 len: 1303 microversion: 2.1 time: 0.113240 Sep 08 14:02:58.427004 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 553/1112] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:58 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:58.897856 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-468472750", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-336262040", "security_groups": [{"name": "tempest-secgroup-smoke-1740128781"}], "networks": [{"uuid": "61798ddd-de85-4814-b88e-26fd995b29f0"}], "block_device_mapping_v2": [{"uuid": "4e8cd2ee-768a-43de-85f2-c65011c5f0ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:59.010509 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] validate_networks() for [('61798ddd-de85-4814-b88e-26fd995b29f0', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:02:59.377723 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:02:59.378322 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:02:59.378675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:02:59.379075 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:02:59.379477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:02:59.388745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:59.389217 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:59.389644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:59.390395 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:59.390845 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:59.391261 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:59.407449 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Getting quotas for project 1dcae1b090af440f836b18a7bb000c27. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:02:59.411409 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Getting quotas for user 39393f5448ed4c489ae1459d251f50d0 and project 1dcae1b090af440f836b18a7bb000c27. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:02:59.450286 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:59.450969 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:59.457454 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:59.458033 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:59.458547 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:59.459305 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:59.459827 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:59.460314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:59.468517 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:02:59.470917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e8cd2ee-768a-43de-85f2-c65011c5f0ed',volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:02:59.473984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] HTTP exception thrown: Instance 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 could not be found. Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Request method failure captured: Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 HTTP/1.1 Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfYCPc80gqjPfOlxqQ_uFRrUsAkJqnzuQ5144FOhnRLpFY79cOo-Y1VrndU5BOxwHwaZCTcEjTYtEBthW9wmMpWJPEZs13lHfqVuNVZaSMozNalrj7fIIQmVF2yi2zaM6NSRnp9uWPwt34xrr9PkZILnuxRYbKCWG91IQ4Ji0UMa5jM Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 6a848414c86b439c922442d0862c334f Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesActionsTest-1681283525 Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:02:59.475612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6a848414c86b439c922442d0862c334f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6a848414c86b439c922442d0862c334f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6a848414c86b439c922442d0862c334f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6a848414c86b439c922442d0862c334f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-VolumesActionsTest-1681283525 Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 6a848414c86b439c922442d0862c334f Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesActionsTest-1681283525 Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-VolumesActionsTest-1681283525-project Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 52bda0133af44d5ca220ba869fbcb3a9 Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-VolumesActionsTest-1681283525-project Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 could not be found. Sep 08 14:02:59.477330 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '730cfd15-29b6-4857-8e2f-a6bf8fc52ec4'} Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 could not be found. Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:02:59.478550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 could not be found. Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 could not be found. Sep 08 14:02:59.480084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:02:59.481825 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Returning 404 to user: Instance 730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:02:59.481825 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-37827062-d34c-4480-8e32-422790e8ce50 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4" status: 404 len: 111 microversion: 2.1 time: 0.031284 Sep 08 14:02:59.481825 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 554/1113] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:59 2022] GET /compute/v2.1/servers/730cfd15-29b6-4857-8e2f-a6bf8fc52ec4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:02:59.635320 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ee49d7f0-1706-4ecf-971e-e315cd44d6fc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741756 Sep 08 14:02:59.636151 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 560/1114] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 14:02:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:02:59.647547 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-6f7af69b-c532-40db-9b89-94454758f137 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:59.648233 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1125906459", "imageRef": "ea73c16e-d67d-4820-87fb-90fe2a67c57b", "flavorRef": "452", "networks": [{"uuid": "95015f11-4506-4483-bc8b-0d6bce5985db"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:59.648832 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-6f7af69b-c532-40db-9b89-94454758f137 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:59.721275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] validate_networks() for [('95015f11-4506-4483-bc8b-0d6bce5985db', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:02:59.728228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-6f7af69b-c532-40db-9b89-94454758f137 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:59.735862 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-6f7af69b-c532-40db-9b89-94454758f137 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1087 microversion: 2.1 time: 0.092540 Sep 08 14:02:59.742184 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 555/1115] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:59 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1087 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:00.104327 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:03:00.104750 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:03:00.105220 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:03:00.105634 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:03:00.106205 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:03:00.115004 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:00.115463 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:00.115892 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:00.116781 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:00.117239 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:00.117685 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:00.134716 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Getting quotas for project 6a848414c86b439c922442d0862c334f. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:03:00.138677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Getting quotas for user 52bda0133af44d5ca220ba869fbcb3a9 and project 6a848414c86b439c922442d0862c334f. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:03:00.150520 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:03:00.152647 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea73c16e-d67d-4820-87fb-90fe2a67c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:03:00.197432 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9d419adf-589c-493a-be4b-c76e4d2c13ea tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553136 Sep 08 14:03:00.198557 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 561/1116] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 14:02:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:03:00.209340 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ad1e87fc-da4d-457a-9f02-08ed768d8d62 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:00.209979 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ad1e87fc-da4d-457a-9f02-08ed768d8d62 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:00.279156 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ad1e87fc-da4d-457a-9f02-08ed768d8d62 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:00.287926 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ad1e87fc-da4d-457a-9f02-08ed768d8d62 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1214 microversion: 2.1 time: 0.082351 Sep 08 14:03:00.288738 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 556/1117] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:00 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:00.759667 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64acaba2-12c7-4cb3-a42d-97bd286831c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:00.760288 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-64acaba2-12c7-4cb3-a42d-97bd286831c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:00.766418 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64acaba2-12c7-4cb3-a42d-97bd286831c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:00.766902 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64acaba2-12c7-4cb3-a42d-97bd286831c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:00.767318 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64acaba2-12c7-4cb3-a42d-97bd286831c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:00.767995 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64acaba2-12c7-4cb3-a42d-97bd286831c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:00.768436 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64acaba2-12c7-4cb3-a42d-97bd286831c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:00.768848 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64acaba2-12c7-4cb3-a42d-97bd286831c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:00.830743 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-64acaba2-12c7-4cb3-a42d-97bd286831c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:00.843258 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64acaba2-12c7-4cb3-a42d-97bd286831c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1185 microversion: 2.1 time: 0.087123 Sep 08 14:03:00.844764 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 562/1118] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:00 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:01.312116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8836eb54-ea86-49b5-b20c-65edeabeba60 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:01.313037 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8836eb54-ea86-49b5-b20c-65edeabeba60 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:01.323390 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8836eb54-ea86-49b5-b20c-65edeabeba60 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:01.323883 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8836eb54-ea86-49b5-b20c-65edeabeba60 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:01.324320 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8836eb54-ea86-49b5-b20c-65edeabeba60 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:01.325032 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8836eb54-ea86-49b5-b20c-65edeabeba60 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:01.325482 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8836eb54-ea86-49b5-b20c-65edeabeba60 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:01.325934 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8836eb54-ea86-49b5-b20c-65edeabeba60 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:01.418096 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8836eb54-ea86-49b5-b20c-65edeabeba60 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:01.425642 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8836eb54-ea86-49b5-b20c-65edeabeba60 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1266 microversion: 2.1 time: 0.117807 Sep 08 14:03:01.426245 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 557/1119] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:01 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:01.869060 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-740e0b87-54c5-4439-aa84-19b7c5fa1b48 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:01.869677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-740e0b87-54c5-4439-aa84-19b7c5fa1b48 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:01.876127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-740e0b87-54c5-4439-aa84-19b7c5fa1b48 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:01.876647 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-740e0b87-54c5-4439-aa84-19b7c5fa1b48 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:01.877073 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-740e0b87-54c5-4439-aa84-19b7c5fa1b48 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:01.877979 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-740e0b87-54c5-4439-aa84-19b7c5fa1b48 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:01.878823 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-740e0b87-54c5-4439-aa84-19b7c5fa1b48 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:01.879404 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-740e0b87-54c5-4439-aa84-19b7c5fa1b48 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:02.156930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-740e0b87-54c5-4439-aa84-19b7c5fa1b48 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:02.172041 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-740e0b87-54c5-4439-aa84-19b7c5fa1b48 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1271 microversion: 2.1 time: 0.306828 Sep 08 14:03:02.172632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 563/1120] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:01 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1271 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:02.451849 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-97e3195c-c99f-4344-8f1e-bc2a1a7b54fd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:02.453014 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-97e3195c-c99f-4344-8f1e-bc2a1a7b54fd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:02.458841 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e3195c-c99f-4344-8f1e-bc2a1a7b54fd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:02.459327 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e3195c-c99f-4344-8f1e-bc2a1a7b54fd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:02.459764 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e3195c-c99f-4344-8f1e-bc2a1a7b54fd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:02.460467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e3195c-c99f-4344-8f1e-bc2a1a7b54fd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:02.461136 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e3195c-c99f-4344-8f1e-bc2a1a7b54fd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:02.462127 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-97e3195c-c99f-4344-8f1e-bc2a1a7b54fd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:02.556749 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-97e3195c-c99f-4344-8f1e-bc2a1a7b54fd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:02.565017 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-97e3195c-c99f-4344-8f1e-bc2a1a7b54fd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1272 microversion: 2.1 time: 0.118860 Sep 08 14:03:02.565680 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 558/1121] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:02 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1272 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:03.195442 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-20f0c32b-6430-427d-8cea-4c5299bd78c2 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:03.198025 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-20f0c32b-6430-427d-8cea-4c5299bd78c2 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:03.204409 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f0c32b-6430-427d-8cea-4c5299bd78c2 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:03.204897 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f0c32b-6430-427d-8cea-4c5299bd78c2 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:03.205326 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f0c32b-6430-427d-8cea-4c5299bd78c2 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:03.206047 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f0c32b-6430-427d-8cea-4c5299bd78c2 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:03.206494 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f0c32b-6430-427d-8cea-4c5299bd78c2 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:03.206908 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-20f0c32b-6430-427d-8cea-4c5299bd78c2 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:03.218613 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-2e5f16fb-4e03-4bc9-8e43-e5e53f981bf4 req-a62b5e9c-aee1-4e1d-a81b-8bcffe86ab27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13064b4a-3c9e-4c93-96fe-7779d873e832", "tag": "bd7535b1-15c4-42a1-b1c2-93844a3b30f1"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:03.228033 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2e5f16fb-4e03-4bc9-8e43-e5e53f981bf4 req-a62b5e9c-aee1-4e1d-a81b-8bcffe86ab27 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:03.228587 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2e5f16fb-4e03-4bc9-8e43-e5e53f981bf4 req-a62b5e9c-aee1-4e1d-a81b-8bcffe86ab27 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:03.229086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2e5f16fb-4e03-4bc9-8e43-e5e53f981bf4 req-a62b5e9c-aee1-4e1d-a81b-8bcffe86ab27 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:03.240878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-2e5f16fb-4e03-4bc9-8e43-e5e53f981bf4 req-a62b5e9c-aee1-4e1d-a81b-8bcffe86ab27 service nova] Creating event network-changed:bd7535b1-15c4-42a1-b1c2-93844a3b30f1 for instance 13064b4a-3c9e-4c93-96fe-7779d873e832 on hv-cinder-82002 Sep 08 14:03:03.246185 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-2e5f16fb-4e03-4bc9-8e43-e5e53f981bf4 req-a62b5e9c-aee1-4e1d-a81b-8bcffe86ab27 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031694 Sep 08 14:03:03.246856 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 559/1122] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:03.360837 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-20f0c32b-6430-427d-8cea-4c5299bd78c2 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:03.369118 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-20f0c32b-6430-427d-8cea-4c5299bd78c2 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.178157 Sep 08 14:03:03.369676 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 564/1123] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:03 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:03.589382 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3a2af138-58b8-4cf0-a78e-b727953afbdc tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:03.590033 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3a2af138-58b8-4cf0-a78e-b727953afbdc tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:03.596328 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a2af138-58b8-4cf0-a78e-b727953afbdc tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:03.596801 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a2af138-58b8-4cf0-a78e-b727953afbdc tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:03.597226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a2af138-58b8-4cf0-a78e-b727953afbdc tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:03.597933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a2af138-58b8-4cf0-a78e-b727953afbdc tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:03.598377 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a2af138-58b8-4cf0-a78e-b727953afbdc tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:03.598797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3a2af138-58b8-4cf0-a78e-b727953afbdc tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:03.724712 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3a2af138-58b8-4cf0-a78e-b727953afbdc tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:03.732798 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3a2af138-58b8-4cf0-a78e-b727953afbdc tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1314 microversion: 2.1 time: 0.148149 Sep 08 14:03:03.733356 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 560/1124] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:03 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:04.391920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9ff3a074-77e2-4480-84dd-35e52deadcdf tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:04.392567 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9ff3a074-77e2-4480-84dd-35e52deadcdf tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:04.399583 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a074-77e2-4480-84dd-35e52deadcdf tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:04.400058 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a074-77e2-4480-84dd-35e52deadcdf tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:04.400484 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a074-77e2-4480-84dd-35e52deadcdf tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:04.401164 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a074-77e2-4480-84dd-35e52deadcdf tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:04.401607 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a074-77e2-4480-84dd-35e52deadcdf tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:04.402049 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9ff3a074-77e2-4480-84dd-35e52deadcdf tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:04.533815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9ff3a074-77e2-4480-84dd-35e52deadcdf tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:04.541674 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9ff3a074-77e2-4480-84dd-35e52deadcdf tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.153614 Sep 08 14:03:04.542267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 565/1125] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:04 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:04.755541 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9f7acb8c-5b1d-4614-8bdc-ebe9345ae20a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:04.756063 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9f7acb8c-5b1d-4614-8bdc-ebe9345ae20a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:04.762822 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7acb8c-5b1d-4614-8bdc-ebe9345ae20a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:04.763314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7acb8c-5b1d-4614-8bdc-ebe9345ae20a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:04.763751 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7acb8c-5b1d-4614-8bdc-ebe9345ae20a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:04.764452 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7acb8c-5b1d-4614-8bdc-ebe9345ae20a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:04.764923 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7acb8c-5b1d-4614-8bdc-ebe9345ae20a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:04.765338 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9f7acb8c-5b1d-4614-8bdc-ebe9345ae20a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:04.891958 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9f7acb8c-5b1d-4614-8bdc-ebe9345ae20a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:04.899672 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9f7acb8c-5b1d-4614-8bdc-ebe9345ae20a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1314 microversion: 2.1 time: 0.148271 Sep 08 14:03:04.900234 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 561/1126] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:04 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:05.566052 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e6ecd22d-7585-407a-8a23-5b91691ff25d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:05.567024 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e6ecd22d-7585-407a-8a23-5b91691ff25d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:05.577195 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6ecd22d-7585-407a-8a23-5b91691ff25d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.577684 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6ecd22d-7585-407a-8a23-5b91691ff25d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.578144 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6ecd22d-7585-407a-8a23-5b91691ff25d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:05.578880 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6ecd22d-7585-407a-8a23-5b91691ff25d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.579346 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6ecd22d-7585-407a-8a23-5b91691ff25d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.579752 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e6ecd22d-7585-407a-8a23-5b91691ff25d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:05.922873 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4e118880-dae7-4614-82c8-9e684e830aa5 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:05.923633 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4e118880-dae7-4614-82c8-9e684e830aa5 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:05.930848 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e118880-dae7-4614-82c8-9e684e830aa5 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.931375 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e118880-dae7-4614-82c8-9e684e830aa5 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.931817 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e118880-dae7-4614-82c8-9e684e830aa5 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:05.932531 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e118880-dae7-4614-82c8-9e684e830aa5 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.932978 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e118880-dae7-4614-82c8-9e684e830aa5 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.933404 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4e118880-dae7-4614-82c8-9e684e830aa5 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:06.247823 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e6ecd22d-7585-407a-8a23-5b91691ff25d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:06.255602 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e6ecd22d-7585-407a-8a23-5b91691ff25d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.694923 Sep 08 14:03:06.256164 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 566/1127] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:05 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:06.292028 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4e118880-dae7-4614-82c8-9e684e830aa5 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:06.300077 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4e118880-dae7-4614-82c8-9e684e830aa5 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1314 microversion: 2.1 time: 0.381089 Sep 08 14:03:06.300732 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 562/1128] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:05 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:07.112886 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-db233fbb-8ac4-47d2-96e5-2ed6646f0462 req-be6fdec1-de67-40de-a050-bcd2d7ec82d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0d5296-0abc-45a9-8f32-0f3e04159f57", "tag": "c3b57e40-056f-4a07-a642-117f26ac12d0"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:07.149430 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-db233fbb-8ac4-47d2-96e5-2ed6646f0462 req-be6fdec1-de67-40de-a050-bcd2d7ec82d7 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:07.150078 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-db233fbb-8ac4-47d2-96e5-2ed6646f0462 req-be6fdec1-de67-40de-a050-bcd2d7ec82d7 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:07.150739 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-db233fbb-8ac4-47d2-96e5-2ed6646f0462 req-be6fdec1-de67-40de-a050-bcd2d7ec82d7 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:07.171077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-db233fbb-8ac4-47d2-96e5-2ed6646f0462 req-be6fdec1-de67-40de-a050-bcd2d7ec82d7 service nova] Creating event network-changed:c3b57e40-056f-4a07-a642-117f26ac12d0 for instance 3b0d5296-0abc-45a9-8f32-0f3e04159f57 on hv-cinder-82002 Sep 08 14:03:07.175921 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-db233fbb-8ac4-47d2-96e5-2ed6646f0462 req-be6fdec1-de67-40de-a050-bcd2d7ec82d7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068986 Sep 08 14:03:07.177896 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 567/1129] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:07.279755 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-bae337e6-165c-486f-9aa2-832cdaab12eb tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:07.280368 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-bae337e6-165c-486f-9aa2-832cdaab12eb tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:07.286787 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bae337e6-165c-486f-9aa2-832cdaab12eb tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:07.287271 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bae337e6-165c-486f-9aa2-832cdaab12eb tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:07.287711 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bae337e6-165c-486f-9aa2-832cdaab12eb tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:07.288398 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bae337e6-165c-486f-9aa2-832cdaab12eb tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:07.288844 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bae337e6-165c-486f-9aa2-832cdaab12eb tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:07.289273 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-bae337e6-165c-486f-9aa2-832cdaab12eb tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:07.324907 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-26b43d72-e3de-4678-9847-c791ab1ff5dd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:07.325597 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-26b43d72-e3de-4678-9847-c791ab1ff5dd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:07.331745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26b43d72-e3de-4678-9847-c791ab1ff5dd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:07.332229 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26b43d72-e3de-4678-9847-c791ab1ff5dd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:07.332659 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26b43d72-e3de-4678-9847-c791ab1ff5dd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:07.333353 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26b43d72-e3de-4678-9847-c791ab1ff5dd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:07.333829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26b43d72-e3de-4678-9847-c791ab1ff5dd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:07.334249 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-26b43d72-e3de-4678-9847-c791ab1ff5dd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:07.509062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-bae337e6-165c-486f-9aa2-832cdaab12eb tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:07.516741 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-bae337e6-165c-486f-9aa2-832cdaab12eb tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.240863 Sep 08 14:03:07.517505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 563/1130] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:07 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:07.534613 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-26b43d72-e3de-4678-9847-c791ab1ff5dd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:07.542418 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-26b43d72-e3de-4678-9847-c791ab1ff5dd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1314 microversion: 2.1 time: 0.222082 Sep 08 14:03:07.543111 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 568/1131] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:07 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:08.539342 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4d71405e-7f01-4f32-a6bf-726cef72dca8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:08.540432 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4d71405e-7f01-4f32-a6bf-726cef72dca8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:08.546955 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d71405e-7f01-4f32-a6bf-726cef72dca8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.547436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d71405e-7f01-4f32-a6bf-726cef72dca8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.547878 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d71405e-7f01-4f32-a6bf-726cef72dca8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.548567 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d71405e-7f01-4f32-a6bf-726cef72dca8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.549023 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d71405e-7f01-4f32-a6bf-726cef72dca8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.549444 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4d71405e-7f01-4f32-a6bf-726cef72dca8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.568155 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0978932b-ea14-4bdc-94ef-e3ec7178a43b tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:08.569105 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0978932b-ea14-4bdc-94ef-e3ec7178a43b tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:08.572565 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:08.576381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0978932b-ea14-4bdc-94ef-e3ec7178a43b tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.576859 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0978932b-ea14-4bdc-94ef-e3ec7178a43b tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.577281 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0978932b-ea14-4bdc-94ef-e3ec7178a43b tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.578001 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0978932b-ea14-4bdc-94ef-e3ec7178a43b tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.578505 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0978932b-ea14-4bdc-94ef-e3ec7178a43b tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.578912 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0978932b-ea14-4bdc-94ef-e3ec7178a43b tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.779141 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4d71405e-7f01-4f32-a6bf-726cef72dca8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:08.786925 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4d71405e-7f01-4f32-a6bf-726cef72dca8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.251488 Sep 08 14:03:08.787494 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 564/1132] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:08 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:08.812464 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0978932b-ea14-4bdc-94ef-e3ec7178a43b tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:08.820096 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0978932b-ea14-4bdc-94ef-e3ec7178a43b tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1314 microversion: 2.1 time: 0.258131 Sep 08 14:03:08.821202 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 569/1133] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:08 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:09.809242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-0acb33c4-77cb-4393-97d1-3d038ff532ca tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:09.809884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-0acb33c4-77cb-4393-97d1-3d038ff532ca tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:09.812306 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:09.817745 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0acb33c4-77cb-4393-97d1-3d038ff532ca tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.818234 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0acb33c4-77cb-4393-97d1-3d038ff532ca tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.818669 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0acb33c4-77cb-4393-97d1-3d038ff532ca tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:09.819366 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0acb33c4-77cb-4393-97d1-3d038ff532ca tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.819819 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0acb33c4-77cb-4393-97d1-3d038ff532ca tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.820240 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-0acb33c4-77cb-4393-97d1-3d038ff532ca tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:09.843284 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5b75e0f3-4655-47c4-9a73-0fd1b1f5b650 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:09.843900 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5b75e0f3-4655-47c4-9a73-0fd1b1f5b650 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:09.850478 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b75e0f3-4655-47c4-9a73-0fd1b1f5b650 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.850964 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b75e0f3-4655-47c4-9a73-0fd1b1f5b650 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.851394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b75e0f3-4655-47c4-9a73-0fd1b1f5b650 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:09.852701 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b75e0f3-4655-47c4-9a73-0fd1b1f5b650 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.853301 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b75e0f3-4655-47c4-9a73-0fd1b1f5b650 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.853724 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5b75e0f3-4655-47c4-9a73-0fd1b1f5b650 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:10.017695 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-0acb33c4-77cb-4393-97d1-3d038ff532ca tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:10.025340 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-0acb33c4-77cb-4393-97d1-3d038ff532ca tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.220077 Sep 08 14:03:10.025920 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 565/1134] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:09 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:10.033836 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5b75e0f3-4655-47c4-9a73-0fd1b1f5b650 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:10.042152 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5b75e0f3-4655-47c4-9a73-0fd1b1f5b650 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1314 microversion: 2.1 time: 0.202947 Sep 08 14:03:10.042711 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 570/1135] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:09 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:11.048462 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-c57bcd47-2c1c-4bac-92ac-2a38fdb2d3a1 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:11.049015 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-c57bcd47-2c1c-4bac-92ac-2a38fdb2d3a1 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:11.050918 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell0:SELECT=4 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:11.056453 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c57bcd47-2c1c-4bac-92ac-2a38fdb2d3a1 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.056936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c57bcd47-2c1c-4bac-92ac-2a38fdb2d3a1 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.057371 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c57bcd47-2c1c-4bac-92ac-2a38fdb2d3a1 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.058099 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c57bcd47-2c1c-4bac-92ac-2a38fdb2d3a1 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.058553 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c57bcd47-2c1c-4bac-92ac-2a38fdb2d3a1 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.058995 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-c57bcd47-2c1c-4bac-92ac-2a38fdb2d3a1 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.064458 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5c35cf54-b3dd-414e-9ac2-ebcd528f8568 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:11.065078 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c35cf54-b3dd-414e-9ac2-ebcd528f8568 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:11.067056 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=4 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:11.067707 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=12 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:11.074785 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c35cf54-b3dd-414e-9ac2-ebcd528f8568 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.075272 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c35cf54-b3dd-414e-9ac2-ebcd528f8568 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.075700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c35cf54-b3dd-414e-9ac2-ebcd528f8568 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.076400 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c35cf54-b3dd-414e-9ac2-ebcd528f8568 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.076851 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c35cf54-b3dd-414e-9ac2-ebcd528f8568 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.077272 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c35cf54-b3dd-414e-9ac2-ebcd528f8568 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.250322 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-c57bcd47-2c1c-4bac-92ac-2a38fdb2d3a1 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:11.258634 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-c57bcd47-2c1c-4bac-92ac-2a38fdb2d3a1 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.213482 Sep 08 14:03:11.259214 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 566/1136] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:11 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:11.274227 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c35cf54-b3dd-414e-9ac2-ebcd528f8568 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:11.281842 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5c35cf54-b3dd-414e-9ac2-ebcd528f8568 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1314 microversion: 2.1 time: 0.221374 Sep 08 14:03:11.282466 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 571/1137] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:11 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:12.282139 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-34dd7e49-7524-4db0-b675-b751e599c64f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:12.282687 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-34dd7e49-7524-4db0-b675-b751e599c64f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:12.289805 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34dd7e49-7524-4db0-b675-b751e599c64f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.290286 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34dd7e49-7524-4db0-b675-b751e599c64f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.290714 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34dd7e49-7524-4db0-b675-b751e599c64f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.291407 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34dd7e49-7524-4db0-b675-b751e599c64f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.291849 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34dd7e49-7524-4db0-b675-b751e599c64f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.292271 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34dd7e49-7524-4db0-b675-b751e599c64f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.305422 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-654c3776-c684-449b-925b-b356cdafe57e tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:12.306070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-654c3776-c684-449b-925b-b356cdafe57e tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:12.312403 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-654c3776-c684-449b-925b-b356cdafe57e tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.312885 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-654c3776-c684-449b-925b-b356cdafe57e tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.313321 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-654c3776-c684-449b-925b-b356cdafe57e tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.314035 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-654c3776-c684-449b-925b-b356cdafe57e tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.314488 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-654c3776-c684-449b-925b-b356cdafe57e tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.314909 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-654c3776-c684-449b-925b-b356cdafe57e tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.336087 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=100 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:12.484732 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-34dd7e49-7524-4db0-b675-b751e599c64f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:12.492350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-34dd7e49-7524-4db0-b675-b751e599c64f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.214235 Sep 08 14:03:12.493550 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 567/1138] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:12 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:12.511446 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-654c3776-c684-449b-925b-b356cdafe57e tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:12.519005 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-654c3776-c684-449b-925b-b356cdafe57e tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1314 microversion: 2.1 time: 0.217915 Sep 08 14:03:12.519559 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 572/1139] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:12 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:13.515253 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7d65ef3b-29dc-469b-ae9c-92a1e46849fa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:13.515861 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7d65ef3b-29dc-469b-ae9c-92a1e46849fa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:13.522502 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d65ef3b-29dc-469b-ae9c-92a1e46849fa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.522988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d65ef3b-29dc-469b-ae9c-92a1e46849fa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.523426 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d65ef3b-29dc-469b-ae9c-92a1e46849fa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.524146 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d65ef3b-29dc-469b-ae9c-92a1e46849fa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.524597 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d65ef3b-29dc-469b-ae9c-92a1e46849fa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.525055 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7d65ef3b-29dc-469b-ae9c-92a1e46849fa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.541419 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-565636a8-84c1-4edf-b9f5-16a98048e224 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:13.542127 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-565636a8-84c1-4edf-b9f5-16a98048e224 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:13.548698 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-565636a8-84c1-4edf-b9f5-16a98048e224 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.549180 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-565636a8-84c1-4edf-b9f5-16a98048e224 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.549612 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-565636a8-84c1-4edf-b9f5-16a98048e224 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.550336 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-565636a8-84c1-4edf-b9f5-16a98048e224 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.550812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-565636a8-84c1-4edf-b9f5-16a98048e224 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.551231 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-565636a8-84c1-4edf-b9f5-16a98048e224 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.735475 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7d65ef3b-29dc-469b-ae9c-92a1e46849fa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:13.744678 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7d65ef3b-29dc-469b-ae9c-92a1e46849fa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.233200 Sep 08 14:03:13.745491 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 568/1140] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:13 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:13.750165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-21aee243-8e76-4473-8253-9a6c28f2b4b9 req-9d0b8f8b-7ab8-49cb-aee2-f52377bd1b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0d5296-0abc-45a9-8f32-0f3e04159f57", "name": "network-vif-plugged", "status": "completed", "tag": "c3b57e40-056f-4a07-a642-117f26ac12d0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:13.758756 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-565636a8-84c1-4edf-b9f5-16a98048e224 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:13.760062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-21aee243-8e76-4473-8253-9a6c28f2b4b9 req-9d0b8f8b-7ab8-49cb-aee2-f52377bd1b6d service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.760757 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-21aee243-8e76-4473-8253-9a6c28f2b4b9 req-9d0b8f8b-7ab8-49cb-aee2-f52377bd1b6d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.761402 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-21aee243-8e76-4473-8253-9a6c28f2b4b9 req-9d0b8f8b-7ab8-49cb-aee2-f52377bd1b6d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.769349 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-565636a8-84c1-4edf-b9f5-16a98048e224 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1314 microversion: 2.1 time: 0.232615 Sep 08 14:03:13.770758 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 573/1141] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:13 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:13.776142 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-21aee243-8e76-4473-8253-9a6c28f2b4b9 req-9d0b8f8b-7ab8-49cb-aee2-f52377bd1b6d service nova] Creating event network-vif-plugged:c3b57e40-056f-4a07-a642-117f26ac12d0 for instance 3b0d5296-0abc-45a9-8f32-0f3e04159f57 on hv-cinder-82002 Sep 08 14:03:13.787361 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-21aee243-8e76-4473-8253-9a6c28f2b4b9 req-9d0b8f8b-7ab8-49cb-aee2-f52377bd1b6d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040534 Sep 08 14:03:13.787971 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 569/1142] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:14.768152 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ce28c069-b000-4cd2-8465-d247aa104cea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:14.768765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ce28c069-b000-4cd2-8465-d247aa104cea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:14.771091 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:14.777099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce28c069-b000-4cd2-8465-d247aa104cea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.777587 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce28c069-b000-4cd2-8465-d247aa104cea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.778113 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce28c069-b000-4cd2-8465-d247aa104cea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.778803 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce28c069-b000-4cd2-8465-d247aa104cea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.779248 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce28c069-b000-4cd2-8465-d247aa104cea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.779659 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ce28c069-b000-4cd2-8465-d247aa104cea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.793865 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-caab462b-f1ae-4707-9398-50560b5e330f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:14.794565 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-caab462b-f1ae-4707-9398-50560b5e330f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:14.800543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caab462b-f1ae-4707-9398-50560b5e330f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.801019 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caab462b-f1ae-4707-9398-50560b5e330f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.801452 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caab462b-f1ae-4707-9398-50560b5e330f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.802173 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caab462b-f1ae-4707-9398-50560b5e330f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.802620 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caab462b-f1ae-4707-9398-50560b5e330f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.803040 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-caab462b-f1ae-4707-9398-50560b5e330f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.980603 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ce28c069-b000-4cd2-8465-d247aa104cea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:14.983897 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-caab462b-f1ae-4707-9398-50560b5e330f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:14.988290 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ce28c069-b000-4cd2-8465-d247aa104cea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.223973 Sep 08 14:03:14.988963 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 574/1143] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:14 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:14.991678 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-caab462b-f1ae-4707-9398-50560b5e330f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1314 microversion: 2.1 time: 0.202796 Sep 08 14:03:14.992804 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 570/1144] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:14 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:16.012586 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-1f02a657-1cee-4ea3-96b6-e04debbdcfa9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:16.013201 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-1f02a657-1cee-4ea3-96b6-e04debbdcfa9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:16.014419 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4c77586f-f041-4100-9cd0-eb1ae7e0c9a8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:16.015040 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4c77586f-f041-4100-9cd0-eb1ae7e0c9a8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:16.022238 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c77586f-f041-4100-9cd0-eb1ae7e0c9a8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.022663 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c77586f-f041-4100-9cd0-eb1ae7e0c9a8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.023140 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c77586f-f041-4100-9cd0-eb1ae7e0c9a8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.023307 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f02a657-1cee-4ea3-96b6-e04debbdcfa9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.024412 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c77586f-f041-4100-9cd0-eb1ae7e0c9a8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.024599 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f02a657-1cee-4ea3-96b6-e04debbdcfa9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.024886 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f02a657-1cee-4ea3-96b6-e04debbdcfa9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.024997 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c77586f-f041-4100-9cd0-eb1ae7e0c9a8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.025776 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4c77586f-f041-4100-9cd0-eb1ae7e0c9a8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.027269 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f02a657-1cee-4ea3-96b6-e04debbdcfa9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.027740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f02a657-1cee-4ea3-96b6-e04debbdcfa9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.028400 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-1f02a657-1cee-4ea3-96b6-e04debbdcfa9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.228511 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-1f02a657-1cee-4ea3-96b6-e04debbdcfa9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:16.233061 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-4c77586f-f041-4100-9cd0-eb1ae7e0c9a8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:16.238066 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-1f02a657-1cee-4ea3-96b6-e04debbdcfa9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.230765 Sep 08 14:03:16.238668 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 575/1145] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:16 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:16.250356 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4c77586f-f041-4100-9cd0-eb1ae7e0c9a8 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1498 microversion: 2.1 time: 0.239764 Sep 08 14:03:16.251078 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 571/1146] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:16 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1498 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:16.989432 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a835c386-cba7-4341-b80d-0fb423fcac1a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:16.989975 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a835c386-cba7-4341-b80d-0fb423fcac1a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:16.996573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a835c386-cba7-4341-b80d-0fb423fcac1a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.997057 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a835c386-cba7-4341-b80d-0fb423fcac1a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.997484 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a835c386-cba7-4341-b80d-0fb423fcac1a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.998210 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a835c386-cba7-4341-b80d-0fb423fcac1a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.998666 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a835c386-cba7-4341-b80d-0fb423fcac1a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.999088 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a835c386-cba7-4341-b80d-0fb423fcac1a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.026533 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a835c386-cba7-4341-b80d-0fb423fcac1a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:03:17.099961 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a835c386-cba7-4341-b80d-0fb423fcac1a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 204 len: 0 microversion: 2.1 time: 0.114242 Sep 08 14:03:17.100547 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 576/1147] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:03:16 2022] DELETE /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:03:17.116922 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-fabc4967-d814-4152-add9-135520e45655 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:17.118107 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-fabc4967-d814-4152-add9-135520e45655 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:17.124608 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabc4967-d814-4152-add9-135520e45655 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.125089 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabc4967-d814-4152-add9-135520e45655 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.125521 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabc4967-d814-4152-add9-135520e45655 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.126284 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabc4967-d814-4152-add9-135520e45655 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.126740 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabc4967-d814-4152-add9-135520e45655 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.127162 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-fabc4967-d814-4152-add9-135520e45655 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.261217 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bc210020-9d81-4371-ac93-2e25bd6800ed tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:17.261898 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-fabc4967-d814-4152-add9-135520e45655 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:17.262030 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bc210020-9d81-4371-ac93-2e25bd6800ed tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:17.268031 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc210020-9d81-4371-ac93-2e25bd6800ed tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.268518 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc210020-9d81-4371-ac93-2e25bd6800ed tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.268962 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc210020-9d81-4371-ac93-2e25bd6800ed tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.269656 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc210020-9d81-4371-ac93-2e25bd6800ed tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.269819 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-fabc4967-d814-4152-add9-135520e45655 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1504 microversion: 2.1 time: 0.163889 Sep 08 14:03:17.270131 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc210020-9d81-4371-ac93-2e25bd6800ed tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.281766 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bc210020-9d81-4371-ac93-2e25bd6800ed tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.282705 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 572/1148] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:17 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:17.415877 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-bc210020-9d81-4371-ac93-2e25bd6800ed tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:17.423535 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bc210020-9d81-4371-ac93-2e25bd6800ed tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.166774 Sep 08 14:03:17.424091 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 577/1149] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:17 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:18.295705 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-656e3383-102d-42fd-9d78-7044a59f506a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:18.296311 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-656e3383-102d-42fd-9d78-7044a59f506a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:18.302637 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-656e3383-102d-42fd-9d78-7044a59f506a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.303115 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-656e3383-102d-42fd-9d78-7044a59f506a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.303547 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-656e3383-102d-42fd-9d78-7044a59f506a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:18.304226 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-656e3383-102d-42fd-9d78-7044a59f506a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.304723 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-656e3383-102d-42fd-9d78-7044a59f506a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.305141 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-656e3383-102d-42fd-9d78-7044a59f506a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:18.446330 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3734084a-d300-4609-b541-65a5605a4eb8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:18.446946 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3734084a-d300-4609-b541-65a5605a4eb8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:18.450136 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-656e3383-102d-42fd-9d78-7044a59f506a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:18.454183 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3734084a-d300-4609-b541-65a5605a4eb8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.454668 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3734084a-d300-4609-b541-65a5605a4eb8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.455095 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3734084a-d300-4609-b541-65a5605a4eb8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:18.455791 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3734084a-d300-4609-b541-65a5605a4eb8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.456238 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3734084a-d300-4609-b541-65a5605a4eb8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.456651 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3734084a-d300-4609-b541-65a5605a4eb8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:18.458598 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-656e3383-102d-42fd-9d78-7044a59f506a tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1504 microversion: 2.1 time: 0.166807 Sep 08 14:03:18.459176 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 573/1150] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:18 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:18.588777 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3734084a-d300-4609-b541-65a5605a4eb8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:18.597275 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3734084a-d300-4609-b541-65a5605a4eb8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.155478 Sep 08 14:03:18.597852 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 578/1151] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:18 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:19.482402 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a15305d2-d078-4afe-a18f-82a00415b7cd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:19.483043 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a15305d2-d078-4afe-a18f-82a00415b7cd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:19.489572 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a15305d2-d078-4afe-a18f-82a00415b7cd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:19.490084 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a15305d2-d078-4afe-a18f-82a00415b7cd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:19.490520 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a15305d2-d078-4afe-a18f-82a00415b7cd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:19.491209 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a15305d2-d078-4afe-a18f-82a00415b7cd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:19.491658 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a15305d2-d078-4afe-a18f-82a00415b7cd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:19.492586 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a15305d2-d078-4afe-a18f-82a00415b7cd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:19.620309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-29136fab-08b2-477e-8cee-cdd9674511b9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:19.621129 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-29136fab-08b2-477e-8cee-cdd9674511b9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:19.627875 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29136fab-08b2-477e-8cee-cdd9674511b9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:19.628352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29136fab-08b2-477e-8cee-cdd9674511b9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:19.628812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29136fab-08b2-477e-8cee-cdd9674511b9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:19.629511 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29136fab-08b2-477e-8cee-cdd9674511b9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:19.629995 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29136fab-08b2-477e-8cee-cdd9674511b9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:19.630340 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a15305d2-d078-4afe-a18f-82a00415b7cd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:19.630471 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-29136fab-08b2-477e-8cee-cdd9674511b9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:19.638721 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a15305d2-d078-4afe-a18f-82a00415b7cd tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1504 microversion: 2.1 time: 0.160147 Sep 08 14:03:19.639284 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 574/1152] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:19 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:19.767667 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-29136fab-08b2-477e-8cee-cdd9674511b9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:19.775318 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-29136fab-08b2-477e-8cee-cdd9674511b9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.159401 Sep 08 14:03:19.775879 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 579/1153] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:19 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:20.661377 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-8d4f72d4-1e0a-459f-9356-4f9a20a97252 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:20.662142 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-8d4f72d4-1e0a-459f-9356-4f9a20a97252 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:20.668770 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d4f72d4-1e0a-459f-9356-4f9a20a97252 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:20.669253 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d4f72d4-1e0a-459f-9356-4f9a20a97252 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:20.669939 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d4f72d4-1e0a-459f-9356-4f9a20a97252 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.670644 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d4f72d4-1e0a-459f-9356-4f9a20a97252 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:20.671113 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d4f72d4-1e0a-459f-9356-4f9a20a97252 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:20.671532 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-8d4f72d4-1e0a-459f-9356-4f9a20a97252 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.770506 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-6423ea47-f718-40a5-ad67-71faefb4ec73 req-963c93b4-0ee4-413c-abc6-490b83505cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13064b4a-3c9e-4c93-96fe-7779d873e832", "name": "network-vif-plugged", "status": "completed", "tag": "bd7535b1-15c4-42a1-b1c2-93844a3b30f1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:20.782018 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6423ea47-f718-40a5-ad67-71faefb4ec73 req-963c93b4-0ee4-413c-abc6-490b83505cc4 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:20.782873 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6423ea47-f718-40a5-ad67-71faefb4ec73 req-963c93b4-0ee4-413c-abc6-490b83505cc4 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:20.783693 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-6423ea47-f718-40a5-ad67-71faefb4ec73 req-963c93b4-0ee4-413c-abc6-490b83505cc4 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.798365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-6423ea47-f718-40a5-ad67-71faefb4ec73 req-963c93b4-0ee4-413c-abc6-490b83505cc4 service nova] Creating event network-vif-plugged:bd7535b1-15c4-42a1-b1c2-93844a3b30f1 for instance 13064b4a-3c9e-4c93-96fe-7779d873e832 on hv-cinder-82002 Sep 08 14:03:20.803866 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-6423ea47-f718-40a5-ad67-71faefb4ec73 req-963c93b4-0ee4-413c-abc6-490b83505cc4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037199 Sep 08 14:03:20.804918 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 580/1154] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:20.805846 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-8d4f72d4-1e0a-459f-9356-4f9a20a97252 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:20.811114 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7ce4afc9-45d9-4337-9223-e69624fa9b75 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:20.812360 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7ce4afc9-45d9-4337-9223-e69624fa9b75 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:20.815946 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-8d4f72d4-1e0a-459f-9356-4f9a20a97252 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1504 microversion: 2.1 time: 0.158402 Sep 08 14:03:20.816598 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 575/1155] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:20 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:20.819485 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce4afc9-45d9-4337-9223-e69624fa9b75 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:20.820185 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce4afc9-45d9-4337-9223-e69624fa9b75 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:20.821586 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce4afc9-45d9-4337-9223-e69624fa9b75 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.822565 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce4afc9-45d9-4337-9223-e69624fa9b75 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:20.823203 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce4afc9-45d9-4337-9223-e69624fa9b75 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:20.823745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7ce4afc9-45d9-4337-9223-e69624fa9b75 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.972854 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7ce4afc9-45d9-4337-9223-e69624fa9b75 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:20.980416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7ce4afc9-45d9-4337-9223-e69624fa9b75 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.174306 Sep 08 14:03:20.980974 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 581/1156] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:20 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:21.840677 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1a8701b7-545d-4b51-90d0-7015e620c05d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:21.841424 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1a8701b7-545d-4b51-90d0-7015e620c05d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:21.847835 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a8701b7-545d-4b51-90d0-7015e620c05d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:21.848321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a8701b7-545d-4b51-90d0-7015e620c05d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:21.848753 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a8701b7-545d-4b51-90d0-7015e620c05d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:21.849447 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a8701b7-545d-4b51-90d0-7015e620c05d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:21.849936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a8701b7-545d-4b51-90d0-7015e620c05d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:21.850360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1a8701b7-545d-4b51-90d0-7015e620c05d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:21.978201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1a8701b7-545d-4b51-90d0-7015e620c05d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:21.985941 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1a8701b7-545d-4b51-90d0-7015e620c05d tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1504 microversion: 2.1 time: 0.149917 Sep 08 14:03:21.986516 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 576/1157] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:21 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:22.003587 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a5704b8b-798b-46a1-baa5-66a8e712c047 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:22.004196 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a5704b8b-798b-46a1-baa5-66a8e712c047 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:22.010739 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5704b8b-798b-46a1-baa5-66a8e712c047 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:22.011214 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5704b8b-798b-46a1-baa5-66a8e712c047 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:22.011642 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5704b8b-798b-46a1-baa5-66a8e712c047 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:22.012327 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5704b8b-798b-46a1-baa5-66a8e712c047 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:22.012803 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5704b8b-798b-46a1-baa5-66a8e712c047 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:22.013221 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a5704b8b-798b-46a1-baa5-66a8e712c047 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:22.150743 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a5704b8b-798b-46a1-baa5-66a8e712c047 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:22.158415 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a5704b8b-798b-46a1-baa5-66a8e712c047 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.158811 Sep 08 14:03:22.158985 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 582/1158] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:21 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:23.008683 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e67e75d8-5401-48f3-bc82-c3f27f7e149f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:23.009485 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e67e75d8-5401-48f3-bc82-c3f27f7e149f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:23.016942 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e67e75d8-5401-48f3-bc82-c3f27f7e149f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.017433 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e67e75d8-5401-48f3-bc82-c3f27f7e149f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.017911 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e67e75d8-5401-48f3-bc82-c3f27f7e149f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.018623 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e67e75d8-5401-48f3-bc82-c3f27f7e149f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.019086 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e67e75d8-5401-48f3-bc82-c3f27f7e149f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.019514 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e67e75d8-5401-48f3-bc82-c3f27f7e149f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.181702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-19542ab1-482b-4760-8818-fc727eb1391b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:23.183121 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-19542ab1-482b-4760-8818-fc727eb1391b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:23.190483 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19542ab1-482b-4760-8818-fc727eb1391b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.191007 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19542ab1-482b-4760-8818-fc727eb1391b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.191441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19542ab1-482b-4760-8818-fc727eb1391b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.192142 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19542ab1-482b-4760-8818-fc727eb1391b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.192618 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19542ab1-482b-4760-8818-fc727eb1391b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.193035 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-19542ab1-482b-4760-8818-fc727eb1391b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.332666 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e67e75d8-5401-48f3-bc82-c3f27f7e149f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:23.345635 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e67e75d8-5401-48f3-bc82-c3f27f7e149f tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1504 microversion: 2.1 time: 0.340757 Sep 08 14:03:23.346771 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 577/1159] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:23 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:23.438401 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-19542ab1-482b-4760-8818-fc727eb1391b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:23.446248 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-19542ab1-482b-4760-8818-fc727eb1391b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.269621 Sep 08 14:03:23.446910 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 583/1160] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:23 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:23.670512 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-559349ae-0900-4a40-ad52-cce1dd4f70c5 req-4e603eb6-dce3-48e9-9c18-7f7745426ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0d5296-0abc-45a9-8f32-0f3e04159f57", "name": "network-vif-deleted", "tag": "c3b57e40-056f-4a07-a642-117f26ac12d0"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:23.681831 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-559349ae-0900-4a40-ad52-cce1dd4f70c5 req-4e603eb6-dce3-48e9-9c18-7f7745426ef6 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.682315 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-559349ae-0900-4a40-ad52-cce1dd4f70c5 req-4e603eb6-dce3-48e9-9c18-7f7745426ef6 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.683020 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-559349ae-0900-4a40-ad52-cce1dd4f70c5 req-4e603eb6-dce3-48e9-9c18-7f7745426ef6 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.695858 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-559349ae-0900-4a40-ad52-cce1dd4f70c5 req-4e603eb6-dce3-48e9-9c18-7f7745426ef6 service nova] Creating event network-vif-deleted:c3b57e40-056f-4a07-a642-117f26ac12d0 for instance 3b0d5296-0abc-45a9-8f32-0f3e04159f57 on hv-cinder-82002 Sep 08 14:03:23.700611 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-559349ae-0900-4a40-ad52-cce1dd4f70c5 req-4e603eb6-dce3-48e9-9c18-7f7745426ef6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033810 Sep 08 14:03:23.701197 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 578/1161] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:24.371171 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:24.371786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:24.378569 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:24.379046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:24.379474 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:24.380165 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:24.380618 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:24.381033 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:24.414542 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:24.415029 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:24.415464 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:24.415898 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lazy-loading 'fault' on Instance uuid 3b0d5296-0abc-45a9-8f32-0f3e04159f57 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:03:24.466935 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:24.469052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3c2a9caa-ec8d-4c96-9910-8d860ebecc87 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:24.469867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3c2a9caa-ec8d-4c96-9910-8d860ebecc87 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:24.476139 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c2a9caa-ec8d-4c96-9910-8d860ebecc87 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:24.476660 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c2a9caa-ec8d-4c96-9910-8d860ebecc87 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:24.477091 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c2a9caa-ec8d-4c96-9910-8d860ebecc87 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:24.477816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c2a9caa-ec8d-4c96-9910-8d860ebecc87 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:24.478266 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c2a9caa-ec8d-4c96-9910-8d860ebecc87 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:24.478888 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3c2a9caa-ec8d-4c96-9910-8d860ebecc87 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:24.479615 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-018b095a-51aa-4a37-8980-53ffe9457654 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1304 microversion: 2.1 time: 0.112777 Sep 08 14:03:24.480394 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 584/1162] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:24 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:24.532525 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1905368636", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-327996144", "security_groups": [{"name": "tempest-secgroup-smoke-1471578861"}], "block_device_mapping_v2": [{"uuid": "e463292e-3659-489a-b7dd-a4655a090bd0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "551d8846-f844-4925-a2fe-eef49820f7af"}]}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:24.634654 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3c2a9caa-ec8d-4c96-9910-8d860ebecc87 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:24.642215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3c2a9caa-ec8d-4c96-9910-8d860ebecc87 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1259 microversion: 2.1 time: 0.177436 Sep 08 14:03:24.642810 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 579/1163] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:24 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:24.664795 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.network.neutron [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] validate_networks() for [('551d8846-f844-4925-a2fe-eef49820f7af', None, None, None, None, None)] {{(pid=126919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:03:25.311778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Flavor limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:03:25.312192 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Image limits 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:03:25.312649 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Flavor pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:03:25.313044 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Image pref 0:0:0 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:03:25.313441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.virt.hardware [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:03:25.322062 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.322528 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.322949 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.323660 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.324105 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.324518 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.341187 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Getting quotas for project 19d114fd258a4306b4c0665df90ae4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:03:25.345077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.quota [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Getting quotas for user 76a9dc3ddb144e599a2856fce8dc339d and project 19d114fd258a4306b4c0665df90ae4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=126919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:03:25.401250 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Going to run 1 instances... {{(pid=126919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:03:25.403405 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e463292e-3659-489a-b7dd-a4655a090bd0',volume_size=None,volume_type=None)] {{(pid=126919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:03:25.504988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:25.505658 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:25.513160 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.514119 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.514680 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.515480 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.516258 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.516762 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.533082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-06955545-332a-4d05-9491-6f8af1ae69ac tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.004413 Sep 08 14:03:25.533968 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 585/1164] 10.222.0.55 () {60 vars in 1147 bytes} [Thu Sep 8 14:03:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:03:25.544793 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-169e6404-70b7-41be-a1c2-0d1277cea482 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:25.545411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-169e6404-70b7-41be-a1c2-0d1277cea482 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:25.548871 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.549353 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.549817 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.550257 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.objects.instance [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lazy-loading 'fault' on Instance uuid 3b0d5296-0abc-45a9-8f32-0f3e04159f57 {{(pid=126920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:03:25.604467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bda0133af44d5ca220ba869fbcb3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a848414c86b439c922442d0862c334f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:25.612378 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-19754900-a087-441d-82d7-24671f11cc26 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 200 len: 1304 microversion: 2.1 time: 0.111635 Sep 08 14:03:25.613921 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 580/1165] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:25 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:25.620385 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-169e6404-70b7-41be-a1c2-0d1277cea482 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:25.629691 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-169e6404-70b7-41be-a1c2-0d1277cea482 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1094 microversion: 2.1 time: 0.088468 Sep 08 14:03:25.630680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 586/1166] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:25 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:25.664576 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-42f40475-a0e7-45e1-99b4-8fc8eab05dea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:25.665058 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-42f40475-a0e7-45e1-99b4-8fc8eab05dea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:25.672001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f40475-a0e7-45e1-99b4-8fc8eab05dea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.672731 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f40475-a0e7-45e1-99b4-8fc8eab05dea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.673182 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f40475-a0e7-45e1-99b4-8fc8eab05dea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.673920 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f40475-a0e7-45e1-99b4-8fc8eab05dea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.674478 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f40475-a0e7-45e1-99b4-8fc8eab05dea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.674903 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-42f40475-a0e7-45e1-99b4-8fc8eab05dea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.839724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-42f40475-a0e7-45e1-99b4-8fc8eab05dea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:25.848548 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-42f40475-a0e7-45e1-99b4-8fc8eab05dea tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1443 microversion: 2.1 time: 0.187955 Sep 08 14:03:25.849121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 581/1167] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:25 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1443 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:25.871278 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4a005249-75c4-4e2c-8d1e-c6699edff0ac tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:25.871901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4a005249-75c4-4e2c-8d1e-c6699edff0ac tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:25.878332 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a005249-75c4-4e2c-8d1e-c6699edff0ac tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.878821 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a005249-75c4-4e2c-8d1e-c6699edff0ac tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.879255 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a005249-75c4-4e2c-8d1e-c6699edff0ac tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.879955 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a005249-75c4-4e2c-8d1e-c6699edff0ac tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.880433 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a005249-75c4-4e2c-8d1e-c6699edff0ac tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.880832 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4a005249-75c4-4e2c-8d1e-c6699edff0ac tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.018628 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-4a005249-75c4-4e2c-8d1e-c6699edff0ac tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:26.027541 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4a005249-75c4-4e2c-8d1e-c6699edff0ac tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1443 microversion: 2.1 time: 0.159552 Sep 08 14:03:26.028111 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 587/1168] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:25 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:26.636354 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:26.636971 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] [instance: 3b0d5296-0abc-45a9-8f32-0f3e04159f57] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:26.643690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.644173 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.644603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.645303 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.645767 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.646187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.652722 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ad3cf7c3-dad0-492d-b89f-f34494d1236f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:26.653331 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ad3cf7c3-dad0-492d-b89f-f34494d1236f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:26.659773 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=100 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:26.663830 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3cf7c3-dad0-492d-b89f-f34494d1236f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.664321 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3cf7c3-dad0-492d-b89f-f34494d1236f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.664751 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3cf7c3-dad0-492d-b89f-f34494d1236f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.665452 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3cf7c3-dad0-492d-b89f-f34494d1236f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.665929 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3cf7c3-dad0-492d-b89f-f34494d1236f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.666347 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ad3cf7c3-dad0-492d-b89f-f34494d1236f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.680314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] HTTP exception thrown: Instance 3b0d5296-0abc-45a9-8f32-0f3e04159f57 could not be found. Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Request method failure captured: Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 HTTP/1.1 Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfYCPc80gqjPfOlxqQ_uFRrUsAkJqnzuQ5144FOhnRLpFY79cOo-Y1VrndU5BOxwHwaZCTcEjTYtEBthW9wmMpWJPEZs13lHfqVuNVZaSMozNalrj7fIIQmVF2yi2zaM6NSRnp9uWPwt34xrr9PkZILnuxRYbKCWG91IQ4Ji0UMa5jM Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 6a848414c86b439c922442d0862c334f Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-VolumesActionsTest-1681283525 Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:03:26.683059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6a848414c86b439c922442d0862c334f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6a848414c86b439c922442d0862c334f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6a848414c86b439c922442d0862c334f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6a848414c86b439c922442d0862c334f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-VolumesActionsTest-1681283525 Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 6a848414c86b439c922442d0862c334f Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-VolumesActionsTest-1681283525 Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-VolumesActionsTest-1681283525-project Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 52bda0133af44d5ca220ba869fbcb3a9 Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-VolumesActionsTest-1681283525-project Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 3b0d5296-0abc-45a9-8f32-0f3e04159f57 could not be found. Sep 08 14:03:26.684549 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '3b0d5296-0abc-45a9-8f32-0f3e04159f57'} Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0d5296-0abc-45a9-8f32-0f3e04159f57 could not be found. Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:03:26.685517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0d5296-0abc-45a9-8f32-0f3e04159f57 could not be found. Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0d5296-0abc-45a9-8f32-0f3e04159f57 could not be found. Sep 08 14:03:26.687177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:03:26.688633 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] Returning 404 to user: Instance 3b0d5296-0abc-45a9-8f32-0f3e04159f57 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:03:26.691177 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-af06221d-73a3-46dd-a6cd-2be931ab4b83 tempest-VolumesActionsTest-1681283525 tempest-VolumesActionsTest-1681283525-project] 10.222.0.55 "GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57" status: 404 len: 111 microversion: 2.1 time: 0.052584 Sep 08 14:03:26.692042 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 582/1169] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:26 2022] GET /compute/v2.1/servers/3b0d5296-0abc-45a9-8f32-0f3e04159f57 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:03:26.761347 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ad3cf7c3-dad0-492d-b89f-f34494d1236f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:26.770198 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ad3cf7c3-dad0-492d-b89f-f34494d1236f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1192 microversion: 2.1 time: 0.121174 Sep 08 14:03:26.770786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 588/1170] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:26 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1192 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:27.795493 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-01a74b3c-2be2-4a5f-9bbc-d0bc096195e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:27.796799 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-01a74b3c-2be2-4a5f-9bbc-d0bc096195e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:27.804061 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01a74b3c-2be2-4a5f-9bbc-d0bc096195e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:27.804763 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01a74b3c-2be2-4a5f-9bbc-d0bc096195e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:27.805347 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01a74b3c-2be2-4a5f-9bbc-d0bc096195e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:27.806271 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01a74b3c-2be2-4a5f-9bbc-d0bc096195e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:27.807026 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01a74b3c-2be2-4a5f-9bbc-d0bc096195e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:27.807603 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-01a74b3c-2be2-4a5f-9bbc-d0bc096195e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:28.085623 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-01a74b3c-2be2-4a5f-9bbc-d0bc096195e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:28.097624 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-01a74b3c-2be2-4a5f-9bbc-d0bc096195e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1278 microversion: 2.1 time: 0.305378 Sep 08 14:03:28.098661 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 583/1171] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:27 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1278 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:28.259518 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-dec60478-0b4f-4195-9d38-fdf3197fd0b1 req-aa97f448-ac32-42d3-9ea6-5f3c12a2f21d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13064b4a-3c9e-4c93-96fe-7779d873e832", "tag": "bd7535b1-15c4-42a1-b1c2-93844a3b30f1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:28.272895 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dec60478-0b4f-4195-9d38-fdf3197fd0b1 req-aa97f448-ac32-42d3-9ea6-5f3c12a2f21d service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:28.274677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dec60478-0b4f-4195-9d38-fdf3197fd0b1 req-aa97f448-ac32-42d3-9ea6-5f3c12a2f21d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:28.276571 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-dec60478-0b4f-4195-9d38-fdf3197fd0b1 req-aa97f448-ac32-42d3-9ea6-5f3c12a2f21d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:28.288317 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-dec60478-0b4f-4195-9d38-fdf3197fd0b1 req-aa97f448-ac32-42d3-9ea6-5f3c12a2f21d service nova] Creating event network-changed:bd7535b1-15c4-42a1-b1c2-93844a3b30f1 for instance 13064b4a-3c9e-4c93-96fe-7779d873e832 on hv-cinder-82002 Sep 08 14:03:28.294355 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-dec60478-0b4f-4195-9d38-fdf3197fd0b1 req-aa97f448-ac32-42d3-9ea6-5f3c12a2f21d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181870 Sep 08 14:03:28.295267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 589/1172] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:28.627255 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-94d78d26-2a7d-4427-9eb2-ee51b7430e2a req-63a70c12-5c2b-4de6-92c3-263968a5c403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bdaa912-aaef-4435-97f9-e20e6ec24dc6", "tag": "c4a0bccd-922e-41f9-8c02-4a2a76cd3707"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:28.636681 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-94d78d26-2a7d-4427-9eb2-ee51b7430e2a req-63a70c12-5c2b-4de6-92c3-263968a5c403 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:28.637155 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-94d78d26-2a7d-4427-9eb2-ee51b7430e2a req-63a70c12-5c2b-4de6-92c3-263968a5c403 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:28.637856 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-94d78d26-2a7d-4427-9eb2-ee51b7430e2a req-63a70c12-5c2b-4de6-92c3-263968a5c403 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:28.648988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-94d78d26-2a7d-4427-9eb2-ee51b7430e2a req-63a70c12-5c2b-4de6-92c3-263968a5c403 service nova] Creating event network-changed:c4a0bccd-922e-41f9-8c02-4a2a76cd3707 for instance 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 on hv-cinder-82002 Sep 08 14:03:28.653867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-94d78d26-2a7d-4427-9eb2-ee51b7430e2a req-63a70c12-5c2b-4de6-92c3-263968a5c403 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030182 Sep 08 14:03:28.654461 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 584/1173] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:29.126188 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-02261fa6-fb5a-4c91-be34-72543b41c381 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:29.127081 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-02261fa6-fb5a-4c91-be34-72543b41c381 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:29.133401 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02261fa6-fb5a-4c91-be34-72543b41c381 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:29.133960 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02261fa6-fb5a-4c91-be34-72543b41c381 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:29.134325 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02261fa6-fb5a-4c91-be34-72543b41c381 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:29.135024 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02261fa6-fb5a-4c91-be34-72543b41c381 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:29.135492 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02261fa6-fb5a-4c91-be34-72543b41c381 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:29.135906 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-02261fa6-fb5a-4c91-be34-72543b41c381 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:29.140172 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:29.275454 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-02261fa6-fb5a-4c91-be34-72543b41c381 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:29.283017 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-02261fa6-fb5a-4c91-be34-72543b41c381 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1278 microversion: 2.1 time: 0.161542 Sep 08 14:03:29.283582 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 590/1174] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:29 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:30.306678 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3186c2c5-4e07-4e4b-9f4b-78890bd44328 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:30.307295 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3186c2c5-4e07-4e4b-9f4b-78890bd44328 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:30.313997 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3186c2c5-4e07-4e4b-9f4b-78890bd44328 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:30.314477 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3186c2c5-4e07-4e4b-9f4b-78890bd44328 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:30.314910 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3186c2c5-4e07-4e4b-9f4b-78890bd44328 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:30.315607 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3186c2c5-4e07-4e4b-9f4b-78890bd44328 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:30.316059 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3186c2c5-4e07-4e4b-9f4b-78890bd44328 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:30.316481 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3186c2c5-4e07-4e4b-9f4b-78890bd44328 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:30.449117 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-3186c2c5-4e07-4e4b-9f4b-78890bd44328 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:30.456590 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3186c2c5-4e07-4e4b-9f4b-78890bd44328 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1278 microversion: 2.1 time: 0.154752 Sep 08 14:03:30.457143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 585/1175] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:30 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:31.481943 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-bf5251d3-6850-4566-bb58-c6b44b042668 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:31.482572 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-bf5251d3-6850-4566-bb58-c6b44b042668 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:31.491600 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf5251d3-6850-4566-bb58-c6b44b042668 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:31.492749 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf5251d3-6850-4566-bb58-c6b44b042668 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:31.493186 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf5251d3-6850-4566-bb58-c6b44b042668 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:31.493917 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf5251d3-6850-4566-bb58-c6b44b042668 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:31.494408 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf5251d3-6850-4566-bb58-c6b44b042668 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:31.494829 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-bf5251d3-6850-4566-bb58-c6b44b042668 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:31.622241 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-bf5251d3-6850-4566-bb58-c6b44b042668 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:31.629798 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-bf5251d3-6850-4566-bb58-c6b44b042668 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1278 microversion: 2.1 time: 0.154509 Sep 08 14:03:31.630362 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 591/1176] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:31 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:32.652207 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-9671235a-b9f8-4438-80e1-bf4f0888a8a2 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:32.652872 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-9671235a-b9f8-4438-80e1-bf4f0888a8a2 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:32.659569 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9671235a-b9f8-4438-80e1-bf4f0888a8a2 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:32.660153 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9671235a-b9f8-4438-80e1-bf4f0888a8a2 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:32.660665 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9671235a-b9f8-4438-80e1-bf4f0888a8a2 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:32.661432 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9671235a-b9f8-4438-80e1-bf4f0888a8a2 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:32.662052 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9671235a-b9f8-4438-80e1-bf4f0888a8a2 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:32.662543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-9671235a-b9f8-4438-80e1-bf4f0888a8a2 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:32.885102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-9671235a-b9f8-4438-80e1-bf4f0888a8a2 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:32.892788 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-9671235a-b9f8-4438-80e1-bf4f0888a8a2 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1278 microversion: 2.1 time: 0.244770 Sep 08 14:03:32.893349 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 586/1177] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:32 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1278 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:33.914869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-38c84375-292f-468d-9f17-d2423be70228 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:33.915477 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-38c84375-292f-468d-9f17-d2423be70228 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:33.922353 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38c84375-292f-468d-9f17-d2423be70228 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:33.923045 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38c84375-292f-468d-9f17-d2423be70228 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:33.923565 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38c84375-292f-468d-9f17-d2423be70228 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:33.924381 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38c84375-292f-468d-9f17-d2423be70228 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:33.925028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38c84375-292f-468d-9f17-d2423be70228 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:33.925700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-38c84375-292f-468d-9f17-d2423be70228 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:34.065627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-38c84375-292f-468d-9f17-d2423be70228 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:34.073392 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-38c84375-292f-468d-9f17-d2423be70228 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1266 microversion: 2.1 time: 0.162836 Sep 08 14:03:34.073992 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 592/1178] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:33 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:35.096368 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a111ee1a-5c79-48e6-9406-aa27669bfb02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:35.096966 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a111ee1a-5c79-48e6-9406-aa27669bfb02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:35.103341 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a111ee1a-5c79-48e6-9406-aa27669bfb02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:35.103932 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a111ee1a-5c79-48e6-9406-aa27669bfb02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:35.104405 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a111ee1a-5c79-48e6-9406-aa27669bfb02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:35.105119 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a111ee1a-5c79-48e6-9406-aa27669bfb02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:35.105578 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a111ee1a-5c79-48e6-9406-aa27669bfb02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:35.106030 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a111ee1a-5c79-48e6-9406-aa27669bfb02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:35.254469 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a111ee1a-5c79-48e6-9406-aa27669bfb02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:35.263254 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a111ee1a-5c79-48e6-9406-aa27669bfb02 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1266 microversion: 2.1 time: 0.170819 Sep 08 14:03:35.263830 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 587/1179] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:35 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:36.288043 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a7ecf27f-a6b5-433c-b955-3f88ef3d6383 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:36.289565 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a7ecf27f-a6b5-433c-b955-3f88ef3d6383 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:36.294631 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:36.295459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell0:SELECT=8 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:36.301771 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7ecf27f-a6b5-433c-b955-3f88ef3d6383 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:36.302441 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7ecf27f-a6b5-433c-b955-3f88ef3d6383 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:36.303070 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7ecf27f-a6b5-433c-b955-3f88ef3d6383 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:36.304514 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7ecf27f-a6b5-433c-b955-3f88ef3d6383 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:36.305126 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7ecf27f-a6b5-433c-b955-3f88ef3d6383 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:36.305823 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a7ecf27f-a6b5-433c-b955-3f88ef3d6383 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:36.446783 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a7ecf27f-a6b5-433c-b955-3f88ef3d6383 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:36.455208 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a7ecf27f-a6b5-433c-b955-3f88ef3d6383 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1266 microversion: 2.1 time: 0.171943 Sep 08 14:03:36.456002 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 593/1180] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:36 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:37.479648 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a4ad2033-95ce-446d-8221-5a314add1218 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:37.480261 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a4ad2033-95ce-446d-8221-5a314add1218 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:37.486948 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4ad2033-95ce-446d-8221-5a314add1218 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:37.487427 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4ad2033-95ce-446d-8221-5a314add1218 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:37.487858 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4ad2033-95ce-446d-8221-5a314add1218 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:37.488544 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4ad2033-95ce-446d-8221-5a314add1218 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:37.489006 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4ad2033-95ce-446d-8221-5a314add1218 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:37.489436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a4ad2033-95ce-446d-8221-5a314add1218 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:37.632925 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a4ad2033-95ce-446d-8221-5a314add1218 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:37.640949 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a4ad2033-95ce-446d-8221-5a314add1218 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1266 microversion: 2.1 time: 0.165738 Sep 08 14:03:37.641601 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 588/1181] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:37 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:38.665914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-aa3ddb9c-d86a-4c39-b7df-fb283e56da65 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:38.666452 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-aa3ddb9c-d86a-4c39-b7df-fb283e56da65 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:38.673171 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa3ddb9c-d86a-4c39-b7df-fb283e56da65 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:38.673959 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa3ddb9c-d86a-4c39-b7df-fb283e56da65 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:38.674604 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa3ddb9c-d86a-4c39-b7df-fb283e56da65 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:38.675480 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa3ddb9c-d86a-4c39-b7df-fb283e56da65 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:38.676230 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa3ddb9c-d86a-4c39-b7df-fb283e56da65 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:38.676651 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-aa3ddb9c-d86a-4c39-b7df-fb283e56da65 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:38.821574 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-aa3ddb9c-d86a-4c39-b7df-fb283e56da65 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:38.831190 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-aa3ddb9c-d86a-4c39-b7df-fb283e56da65 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1266 microversion: 2.1 time: 0.170455 Sep 08 14:03:38.831792 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 594/1182] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:38 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:39.855187 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a3d78962-c4de-4444-9c46-fe9625591006 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:39.855882 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a3d78962-c4de-4444-9c46-fe9625591006 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:39.858776 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=50 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:39.867949 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3d78962-c4de-4444-9c46-fe9625591006 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:39.868436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3d78962-c4de-4444-9c46-fe9625591006 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:39.869015 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3d78962-c4de-4444-9c46-fe9625591006 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:39.869723 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3d78962-c4de-4444-9c46-fe9625591006 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:39.870206 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3d78962-c4de-4444-9c46-fe9625591006 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:39.870630 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a3d78962-c4de-4444-9c46-fe9625591006 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:40.020280 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a3d78962-c4de-4444-9c46-fe9625591006 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:40.029928 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a3d78962-c4de-4444-9c46-fe9625591006 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1266 microversion: 2.1 time: 0.178652 Sep 08 14:03:40.030538 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 589/1183] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:39 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:41.053212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3a77301b-6d4b-4b74-aa52-9b555e06d61a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:41.056170 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3a77301b-6d4b-4b74-aa52-9b555e06d61a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:41.068765 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a77301b-6d4b-4b74-aa52-9b555e06d61a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:41.070160 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a77301b-6d4b-4b74-aa52-9b555e06d61a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:41.070812 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a77301b-6d4b-4b74-aa52-9b555e06d61a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:41.071789 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a77301b-6d4b-4b74-aa52-9b555e06d61a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:41.072505 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a77301b-6d4b-4b74-aa52-9b555e06d61a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:41.073093 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3a77301b-6d4b-4b74-aa52-9b555e06d61a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:41.264016 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3a77301b-6d4b-4b74-aa52-9b555e06d61a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:41.283733 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3a77301b-6d4b-4b74-aa52-9b555e06d61a tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1266 microversion: 2.1 time: 0.229958 Sep 08 14:03:41.285926 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 595/1184] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:41 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:42.312328 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-2a188a8a-cd79-4450-87d6-72a600ba5488 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:42.313671 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-2a188a8a-cd79-4450-87d6-72a600ba5488 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:42.322184 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a188a8a-cd79-4450-87d6-72a600ba5488 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:42.323056 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a188a8a-cd79-4450-87d6-72a600ba5488 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:42.323755 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a188a8a-cd79-4450-87d6-72a600ba5488 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:42.324602 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a188a8a-cd79-4450-87d6-72a600ba5488 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:42.325183 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a188a8a-cd79-4450-87d6-72a600ba5488 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:42.325830 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-2a188a8a-cd79-4450-87d6-72a600ba5488 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:42.501071 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-2a188a8a-cd79-4450-87d6-72a600ba5488 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:42.510351 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-2a188a8a-cd79-4450-87d6-72a600ba5488 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1266 microversion: 2.1 time: 0.201119 Sep 08 14:03:42.510956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 590/1185] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:42 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:43.534702 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a83acbd5-ae84-4286-987a-ba97214b6787 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:43.535333 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a83acbd5-ae84-4286-987a-ba97214b6787 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:43.547909 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83acbd5-ae84-4286-987a-ba97214b6787 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:43.550688 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83acbd5-ae84-4286-987a-ba97214b6787 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:43.551892 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83acbd5-ae84-4286-987a-ba97214b6787 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:43.555755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83acbd5-ae84-4286-987a-ba97214b6787 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:43.557144 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83acbd5-ae84-4286-987a-ba97214b6787 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:43.557841 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a83acbd5-ae84-4286-987a-ba97214b6787 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.098063 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a83acbd5-ae84-4286-987a-ba97214b6787 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:44.105990 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a83acbd5-ae84-4286-987a-ba97214b6787 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1266 microversion: 2.1 time: 0.575841 Sep 08 14:03:44.106563 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 596/1186] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:43 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1266 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:44.178661 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ee727e70-b16d-4ae9-bf24-c90372293bf0 req-45fb7ecd-aaf5-4046-948d-f38bed0ccf91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bdaa912-aaef-4435-97f9-e20e6ec24dc6", "name": "network-vif-plugged", "status": "completed", "tag": "c4a0bccd-922e-41f9-8c02-4a2a76cd3707"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:44.196890 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ee727e70-b16d-4ae9-bf24-c90372293bf0 req-45fb7ecd-aaf5-4046-948d-f38bed0ccf91 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.197993 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ee727e70-b16d-4ae9-bf24-c90372293bf0 req-45fb7ecd-aaf5-4046-948d-f38bed0ccf91 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.198947 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ee727e70-b16d-4ae9-bf24-c90372293bf0 req-45fb7ecd-aaf5-4046-948d-f38bed0ccf91 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.214156 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ee727e70-b16d-4ae9-bf24-c90372293bf0 req-45fb7ecd-aaf5-4046-948d-f38bed0ccf91 service nova] Creating event network-vif-plugged:c4a0bccd-922e-41f9-8c02-4a2a76cd3707 for instance 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 on hv-cinder-82002 Sep 08 14:03:44.221058 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ee727e70-b16d-4ae9-bf24-c90372293bf0 req-45fb7ecd-aaf5-4046-948d-f38bed0ccf91 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048377 Sep 08 14:03:44.222318 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 591/1187] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:45.132459 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-626d5fa8-2011-483d-9067-f58c337887e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:45.133143 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-626d5fa8-2011-483d-9067-f58c337887e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:45.136157 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:45.143914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626d5fa8-2011-483d-9067-f58c337887e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.144435 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626d5fa8-2011-483d-9067-f58c337887e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.144880 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626d5fa8-2011-483d-9067-f58c337887e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.145680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626d5fa8-2011-483d-9067-f58c337887e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.146208 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626d5fa8-2011-483d-9067-f58c337887e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.146656 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-626d5fa8-2011-483d-9067-f58c337887e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.313008 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-626d5fa8-2011-483d-9067-f58c337887e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:45.321803 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-626d5fa8-2011-483d-9067-f58c337887e9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1266 microversion: 2.1 time: 0.193438 Sep 08 14:03:45.322679 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 597/1188] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:45 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:46.349157 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-afd250f1-8665-45a7-86bd-f52ea8ff5675 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:46.350102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-afd250f1-8665-45a7-86bd-f52ea8ff5675 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:46.359152 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afd250f1-8665-45a7-86bd-f52ea8ff5675 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:46.359943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afd250f1-8665-45a7-86bd-f52ea8ff5675 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:46.360384 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afd250f1-8665-45a7-86bd-f52ea8ff5675 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:46.361100 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afd250f1-8665-45a7-86bd-f52ea8ff5675 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:46.361563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afd250f1-8665-45a7-86bd-f52ea8ff5675 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:46.362165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-afd250f1-8665-45a7-86bd-f52ea8ff5675 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:46.587703 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-afd250f1-8665-45a7-86bd-f52ea8ff5675 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:46.596735 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-afd250f1-8665-45a7-86bd-f52ea8ff5675 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1266 microversion: 2.1 time: 0.252329 Sep 08 14:03:46.597602 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 592/1189] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:46 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:47.621740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ec9c7a24-1005-4299-a72f-ac754edba291 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:47.622453 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ec9c7a24-1005-4299-a72f-ac754edba291 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:47.630172 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec9c7a24-1005-4299-a72f-ac754edba291 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.631522 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec9c7a24-1005-4299-a72f-ac754edba291 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.632805 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec9c7a24-1005-4299-a72f-ac754edba291 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.634165 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec9c7a24-1005-4299-a72f-ac754edba291 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.634735 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec9c7a24-1005-4299-a72f-ac754edba291 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.635987 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ec9c7a24-1005-4299-a72f-ac754edba291 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.809903 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-ec9c7a24-1005-4299-a72f-ac754edba291 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:47.818028 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ec9c7a24-1005-4299-a72f-ac754edba291 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1452 microversion: 2.1 time: 0.201348 Sep 08 14:03:47.834066 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 598/1190] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:47 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1452 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:47.843029 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ee4d8391-a0aa-4619-9cac-73ca9ff0fa6c tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:47.843707 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ee4d8391-a0aa-4619-9cac-73ca9ff0fa6c tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:47.850152 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee4d8391-a0aa-4619-9cac-73ca9ff0fa6c tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.850638 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee4d8391-a0aa-4619-9cac-73ca9ff0fa6c tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.851816 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee4d8391-a0aa-4619-9cac-73ca9ff0fa6c tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.852517 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee4d8391-a0aa-4619-9cac-73ca9ff0fa6c tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.853159 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee4d8391-a0aa-4619-9cac-73ca9ff0fa6c tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.854435 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ee4d8391-a0aa-4619-9cac-73ca9ff0fa6c tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:48.016093 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ee4d8391-a0aa-4619-9cac-73ca9ff0fa6c tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:48.024593 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ee4d8391-a0aa-4619-9cac-73ca9ff0fa6c tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1452 microversion: 2.1 time: 0.185797 Sep 08 14:03:48.025170 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 593/1191] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:47 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:50.402212 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-cc62014e-ad01-4445-8149-7c1ae448bb61 req-8a3f144e-3490-40a6-949e-1cb443b2f80d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bdaa912-aaef-4435-97f9-e20e6ec24dc6", "tag": "c4a0bccd-922e-41f9-8c02-4a2a76cd3707"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:50.417815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cc62014e-ad01-4445-8149-7c1ae448bb61 req-8a3f144e-3490-40a6-949e-1cb443b2f80d service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.418555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cc62014e-ad01-4445-8149-7c1ae448bb61 req-8a3f144e-3490-40a6-949e-1cb443b2f80d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.419256 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-cc62014e-ad01-4445-8149-7c1ae448bb61 req-8a3f144e-3490-40a6-949e-1cb443b2f80d service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.433123 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-cc62014e-ad01-4445-8149-7c1ae448bb61 req-8a3f144e-3490-40a6-949e-1cb443b2f80d service nova] Creating event network-changed:c4a0bccd-922e-41f9-8c02-4a2a76cd3707 for instance 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 on hv-cinder-82002 Sep 08 14:03:50.438914 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-cc62014e-ad01-4445-8149-7c1ae448bb61 req-8a3f144e-3490-40a6-949e-1cb443b2f80d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207232 Sep 08 14:03:50.439693 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 599/1192] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:31.395850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:05:31.396386 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Thu Sep 8 14:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 (ip 10.222.0.55) !!! Sep 08 14:05:31.397377 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=9 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:31.398376 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=58 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:31.399391 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:05:31.399854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Thu Sep 8 14:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 (ip 10.222.0.55) !!! Sep 08 14:05:31.399968 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR oslo.messaging._drivers.impl_rabbit [-] [681aadb0-72a9-4de0-bf37-fe69f30c78e2] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 14:05:31.401698 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=5 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:31.402470 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=54 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:31.403689 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:05:31.403822 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-34afbc77-e1b0-4824-b21c-fafca64d1d2e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:31.404229 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Thu Sep 8 14:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.55) !!! Sep 08 14:05:31.404360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-34afbc77-e1b0-4824-b21c-fafca64d1d2e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:31.417048 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34afbc77-e1b0-4824-b21c-fafca64d1d2e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:31.417540 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34afbc77-e1b0-4824-b21c-fafca64d1d2e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:31.418062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34afbc77-e1b0-4824-b21c-fafca64d1d2e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:31.418781 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34afbc77-e1b0-4824-b21c-fafca64d1d2e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:31.419238 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34afbc77-e1b0-4824-b21c-fafca64d1d2e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:31.419664 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-34afbc77-e1b0-4824-b21c-fafca64d1d2e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:31.423815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-5d0546fd-5a2e-4328-b6ac-4a8818ade69e req-6b5e9d75-abb5-4882-9562-0769d031aab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bdaa912-aaef-4435-97f9-e20e6ec24dc6", "tag": "c4a0bccd-922e-41f9-8c02-4a2a76cd3707"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:31.434539 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5d0546fd-5a2e-4328-b6ac-4a8818ade69e req-6b5e9d75-abb5-4882-9562-0769d031aab8 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:31.435012 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5d0546fd-5a2e-4328-b6ac-4a8818ade69e req-6b5e9d75-abb5-4882-9562-0769d031aab8 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:31.435432 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-5d0546fd-5a2e-4328-b6ac-4a8818ade69e req-6b5e9d75-abb5-4882-9562-0769d031aab8 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:31.446581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-5d0546fd-5a2e-4328-b6ac-4a8818ade69e req-6b5e9d75-abb5-4882-9562-0769d031aab8 service nova] Creating event network-changed:c4a0bccd-922e-41f9-8c02-4a2a76cd3707 for instance 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 on hv-cinder-82002 Sep 08 14:05:31.449076 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-34afbc77-e1b0-4824-b21c-fafca64d1d2e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Going to try to terminate instance {{(pid=126920) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:05:31.452235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-5d0546fd-5a2e-4328-b6ac-4a8818ade69e req-6b5e9d75-abb5-4882-9562-0769d031aab8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055510 Sep 08 14:05:31.453013 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 600/1193] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:31.530690 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-34afbc77-e1b0-4824-b21c-fafca64d1d2e tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 204 len: 0 microversion: 2.1 time: 0.136672 Sep 08 14:05:31.531714 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 594/1194] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:05:31 2022] DELETE /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:05:31.541382 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-65bdd8c9-e949-4766-a420-42f7b451ab21 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:31.542198 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-65bdd8c9-e949-4766-a420-42f7b451ab21 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:31.548517 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65bdd8c9-e949-4766-a420-42f7b451ab21 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:31.549099 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65bdd8c9-e949-4766-a420-42f7b451ab21 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:31.549602 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65bdd8c9-e949-4766-a420-42f7b451ab21 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:31.550401 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65bdd8c9-e949-4766-a420-42f7b451ab21 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:31.550923 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65bdd8c9-e949-4766-a420-42f7b451ab21 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:31.551416 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-65bdd8c9-e949-4766-a420-42f7b451ab21 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:31.685988 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-65bdd8c9-e949-4766-a420-42f7b451ab21 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:31.693776 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-65bdd8c9-e949-4766-a420-42f7b451ab21 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1577 microversion: 2.1 time: 0.157219 Sep 08 14:05:31.694341 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 601/1195] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:31 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:32.717242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-906c68e1-604e-49e7-92f8-5b6b6e5ccdf3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:32.717916 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-906c68e1-604e-49e7-92f8-5b6b6e5ccdf3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:32.724393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906c68e1-604e-49e7-92f8-5b6b6e5ccdf3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:32.724873 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906c68e1-604e-49e7-92f8-5b6b6e5ccdf3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:32.725307 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906c68e1-604e-49e7-92f8-5b6b6e5ccdf3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:32.726031 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906c68e1-604e-49e7-92f8-5b6b6e5ccdf3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:32.726483 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906c68e1-604e-49e7-92f8-5b6b6e5ccdf3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:32.726907 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-906c68e1-604e-49e7-92f8-5b6b6e5ccdf3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:32.861055 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-906c68e1-604e-49e7-92f8-5b6b6e5ccdf3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:32.869242 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-906c68e1-604e-49e7-92f8-5b6b6e5ccdf3 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1577 microversion: 2.1 time: 0.156572 Sep 08 14:05:32.869809 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 595/1196] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:32 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:33.894258 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-056d1390-95c7-452c-9e2f-684e931806d8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:33.894868 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-056d1390-95c7-452c-9e2f-684e931806d8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:33.902613 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-056d1390-95c7-452c-9e2f-684e931806d8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.903096 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-056d1390-95c7-452c-9e2f-684e931806d8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.904413 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-056d1390-95c7-452c-9e2f-684e931806d8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:33.904707 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-056d1390-95c7-452c-9e2f-684e931806d8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.905133 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-056d1390-95c7-452c-9e2f-684e931806d8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.905557 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-056d1390-95c7-452c-9e2f-684e931806d8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:33.925760 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO oslo.messaging._drivers.impl_rabbit [-] [681aadb0-72a9-4de0-bf37-fe69f30c78e2] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 44262. Sep 08 14:05:34.144887 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-056d1390-95c7-452c-9e2f-684e931806d8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:34.152539 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-056d1390-95c7-452c-9e2f-684e931806d8 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1577 microversion: 2.1 time: 0.262140 Sep 08 14:05:34.153104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 602/1197] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:33 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1577 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:34.623121 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-ac7f25a9-0f68-4480-a7ac-d931d2fdbc3f req-ad074cf5-ff3f-4c4f-b574-10cb6c369042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bdaa912-aaef-4435-97f9-e20e6ec24dc6", "name": "network-vif-deleted", "tag": "c4a0bccd-922e-41f9-8c02-4a2a76cd3707"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:34.633935 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ac7f25a9-0f68-4480-a7ac-d931d2fdbc3f req-ad074cf5-ff3f-4c4f-b574-10cb6c369042 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:34.634407 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ac7f25a9-0f68-4480-a7ac-d931d2fdbc3f req-ad074cf5-ff3f-4c4f-b574-10cb6c369042 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:34.634834 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-ac7f25a9-0f68-4480-a7ac-d931d2fdbc3f req-ad074cf5-ff3f-4c4f-b574-10cb6c369042 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:34.645814 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-ac7f25a9-0f68-4480-a7ac-d931d2fdbc3f req-ad074cf5-ff3f-4c4f-b574-10cb6c369042 service nova] Creating event network-vif-deleted:c4a0bccd-922e-41f9-8c02-4a2a76cd3707 for instance 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 on hv-cinder-82002 Sep 08 14:05:34.651217 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-ac7f25a9-0f68-4480-a7ac-d931d2fdbc3f req-ad074cf5-ff3f-4c4f-b574-10cb6c369042 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031418 Sep 08 14:05:34.651905 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 596/1198] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:35.176112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:35.176665 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:35.183559 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.184031 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.184455 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.185138 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.185581 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.186022 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.217278 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.217770 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.218199 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.218632 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lazy-loading 'fault' on Instance uuid 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:35.261411 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:35.268895 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-98467afb-185e-449b-aa34-54975769460f tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 200 len: 1230 microversion: 2.1 time: 0.096796 Sep 08 14:05:35.269476 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 603/1199] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:35 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:36.294565 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:36.295802 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 9bdaa912-aaef-4435-97f9-e20e6ec24dc6] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:36.304707 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.305197 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.305638 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:36.306380 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.306841 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.307270 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:36.321227 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] HTTP exception thrown: Instance 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 could not be found. Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Request method failure captured: Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 HTTP/1.1 Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfTEfgn9hqwcQPTZjtjIi_eZbPKBSZw4vbtM7d4LDTgTlcj95rmQME9s9ofUwi3UgHEetwgR-HYhHHMhkou9zN7Go1J_4TsEl0CStTihhXJBw0-4FiYZ7_Xbzi_KVKJVLaXtQ1j1RKE660Xb89-XiiivL_hq3Ec1JfVTeZJOpwvAskc Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 19d114fd258a4306b4c0665df90ae4c7 Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:05:36.323067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19d114fd258a4306b4c0665df90ae4c7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 19d114fd258a4306b4c0665df90ae4c7 Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-TestVolumeBootPattern-572502475-project Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 76a9dc3ddb144e599a2856fce8dc339d Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-TestVolumeBootPattern-572502475-project Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 could not be found. Sep 08 14:05:36.324956 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '9bdaa912-aaef-4435-97f9-e20e6ec24dc6'} Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 could not be found. Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:36.326165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 could not be found. Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 could not be found. Sep 08 14:05:36.328000 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:05:36.329724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Returning 404 to user: Instance 9bdaa912-aaef-4435-97f9-e20e6ec24dc6 could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:36.329724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-3aba8c7b-cdae-4875-b93d-cdd70a716185 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6" status: 404 len: 111 microversion: 2.1 time: 0.034898 Sep 08 14:05:36.329724 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 597/1200] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:36 2022] GET /compute/v2.1/servers/9bdaa912-aaef-4435-97f9-e20e6ec24dc6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:38.675919 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c3d1dee7-898d-4d63-99b2-3955a1718f4d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:38.676550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c3d1dee7-898d-4d63-99b2-3955a1718f4d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:38.683885 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3d1dee7-898d-4d63-99b2-3955a1718f4d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.684372 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3d1dee7-898d-4d63-99b2-3955a1718f4d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.684806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3d1dee7-898d-4d63-99b2-3955a1718f4d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.685561 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3d1dee7-898d-4d63-99b2-3955a1718f4d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.686042 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3d1dee7-898d-4d63-99b2-3955a1718f4d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.686520 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c3d1dee7-898d-4d63-99b2-3955a1718f4d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.709309 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.objects.instance [None req-c3d1dee7-898d-4d63-99b2-3955a1718f4d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lazy-loading 'flavor' on Instance uuid 13064b4a-3c9e-4c93-96fe-7779d873e832 {{(pid=126919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:38.781830 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c3d1dee7-898d-4d63-99b2-3955a1718f4d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "POST /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832/action" status: 202 len: 0 microversion: 2.1 time: 0.109700 Sep 08 14:05:38.782426 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 604/1201] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 14:05:38 2022] POST /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:38.792001 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-7dc94cc4-d59b-4d1c-85aa-174ff3b20a23 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:38.793201 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-7dc94cc4-d59b-4d1c-85aa-174ff3b20a23 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:38.800120 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc94cc4-d59b-4d1c-85aa-174ff3b20a23 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.800541 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc94cc4-d59b-4d1c-85aa-174ff3b20a23 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.801022 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc94cc4-d59b-4d1c-85aa-174ff3b20a23 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.801874 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc94cc4-d59b-4d1c-85aa-174ff3b20a23 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.802331 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc94cc4-d59b-4d1c-85aa-174ff3b20a23 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.803838 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-7dc94cc4-d59b-4d1c-85aa-174ff3b20a23 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.946866 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-7dc94cc4-d59b-4d1c-85aa-174ff3b20a23 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:38.955054 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-7dc94cc4-d59b-4d1c-85aa-174ff3b20a23 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.168077 Sep 08 14:05:38.955645 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 598/1202] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:38 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:39.602721 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-4307305e-1ffa-48ad-a537-9dad6694c958 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:39.603423 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4307305e-1ffa-48ad-a537-9dad6694c958 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:39.603883 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-a2d5db15-32a4-405b-9165-a84f98a550d9 req-2833a215-223f-4bd4-9624-25bff8575e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0fbbab-644f-4d57-b4bf-644204a5b26f", "tag": "07945f23-93ca-4174-93c3-7352e02ec6a5"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:39.610039 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4307305e-1ffa-48ad-a537-9dad6694c958 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.610660 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4307305e-1ffa-48ad-a537-9dad6694c958 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.611197 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4307305e-1ffa-48ad-a537-9dad6694c958 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.611993 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4307305e-1ffa-48ad-a537-9dad6694c958 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.612544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4307305e-1ffa-48ad-a537-9dad6694c958 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.613076 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-4307305e-1ffa-48ad-a537-9dad6694c958 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.613183 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a2d5db15-32a4-405b-9165-a84f98a550d9 req-2833a215-223f-4bd4-9624-25bff8575e95 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.613643 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a2d5db15-32a4-405b-9165-a84f98a550d9 req-2833a215-223f-4bd4-9624-25bff8575e95 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.614091 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-a2d5db15-32a4-405b-9165-a84f98a550d9 req-2833a215-223f-4bd4-9624-25bff8575e95 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.632191 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-a2d5db15-32a4-405b-9165-a84f98a550d9 req-2833a215-223f-4bd4-9624-25bff8575e95 service nova] Creating event network-changed:07945f23-93ca-4174-93c3-7352e02ec6a5 for instance 6c0fbbab-644f-4d57-b4bf-644204a5b26f on hv-cinder-82002 Sep 08 14:05:39.637562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-a2d5db15-32a4-405b-9165-a84f98a550d9 req-2833a215-223f-4bd4-9624-25bff8575e95 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037759 Sep 08 14:05:39.638277 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 599/1203] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:39.642736 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-4307305e-1ffa-48ad-a537-9dad6694c958 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:05:39.718982 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-4307305e-1ffa-48ad-a537-9dad6694c958 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 204 len: 0 microversion: 2.1 time: 0.121017 Sep 08 14:05:39.722804 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 605/1204] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:05:39 2022] DELETE /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:05:39.728458 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-de34bda8-6c55-4bf5-94f1-729392b5cdff tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:39.729243 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-de34bda8-6c55-4bf5-94f1-729392b5cdff tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:39.735401 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de34bda8-6c55-4bf5-94f1-729392b5cdff tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.735885 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de34bda8-6c55-4bf5-94f1-729392b5cdff tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.736321 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de34bda8-6c55-4bf5-94f1-729392b5cdff tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.737018 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de34bda8-6c55-4bf5-94f1-729392b5cdff tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.737472 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de34bda8-6c55-4bf5-94f1-729392b5cdff tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.737952 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-de34bda8-6c55-4bf5-94f1-729392b5cdff tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.873884 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-de34bda8-6c55-4bf5-94f1-729392b5cdff tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:39.882393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-de34bda8-6c55-4bf5-94f1-729392b5cdff tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1577 microversion: 2.1 time: 0.158157 Sep 08 14:05:39.883062 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 600/1205] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:39 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:39.979297 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-c415b2f2-7956-419b-aa15-c3638684aae3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:39.980232 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-c415b2f2-7956-419b-aa15-c3638684aae3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:39.987017 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c415b2f2-7956-419b-aa15-c3638684aae3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.987582 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c415b2f2-7956-419b-aa15-c3638684aae3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.988106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c415b2f2-7956-419b-aa15-c3638684aae3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.988852 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c415b2f2-7956-419b-aa15-c3638684aae3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.989970 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c415b2f2-7956-419b-aa15-c3638684aae3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.990497 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-c415b2f2-7956-419b-aa15-c3638684aae3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:40.125513 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-c415b2f2-7956-419b-aa15-c3638684aae3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:40.133806 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-c415b2f2-7956-419b-aa15-c3638684aae3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.158782 Sep 08 14:05:40.134380 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 606/1206] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:39 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:40.906369 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-06ffa928-571e-425d-be58-c40600b6841b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:40.906971 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-06ffa928-571e-425d-be58-c40600b6841b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:40.913418 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06ffa928-571e-425d-be58-c40600b6841b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:40.913928 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06ffa928-571e-425d-be58-c40600b6841b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:40.914359 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06ffa928-571e-425d-be58-c40600b6841b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:40.915046 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06ffa928-571e-425d-be58-c40600b6841b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:40.915491 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06ffa928-571e-425d-be58-c40600b6841b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:40.915907 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-06ffa928-571e-425d-be58-c40600b6841b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:41.048228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-06ffa928-571e-425d-be58-c40600b6841b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:41.056467 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-06ffa928-571e-425d-be58-c40600b6841b tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1577 microversion: 2.1 time: 0.153963 Sep 08 14:05:41.057026 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 601/1207] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:40 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:41.156568 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-3ad8389e-5a34-42d0-92c3-6d906b39639d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:41.157110 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-3ad8389e-5a34-42d0-92c3-6d906b39639d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:41.163981 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad8389e-5a34-42d0-92c3-6d906b39639d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:41.164462 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad8389e-5a34-42d0-92c3-6d906b39639d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:41.164896 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad8389e-5a34-42d0-92c3-6d906b39639d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:41.165586 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad8389e-5a34-42d0-92c3-6d906b39639d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:41.166065 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad8389e-5a34-42d0-92c3-6d906b39639d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:41.166491 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-3ad8389e-5a34-42d0-92c3-6d906b39639d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:41.294302 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-3ad8389e-5a34-42d0-92c3-6d906b39639d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:41.301960 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-3ad8389e-5a34-42d0-92c3-6d906b39639d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.149276 Sep 08 14:05:41.302525 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 607/1208] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:41 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:42.079838 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-382bde97-de9f-4b02-b805-e28a60fc9df4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:42.080454 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-382bde97-de9f-4b02-b805-e28a60fc9df4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:42.087510 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-382bde97-de9f-4b02-b805-e28a60fc9df4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:42.087988 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-382bde97-de9f-4b02-b805-e28a60fc9df4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:42.088445 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-382bde97-de9f-4b02-b805-e28a60fc9df4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:42.089134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-382bde97-de9f-4b02-b805-e28a60fc9df4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:42.089583 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-382bde97-de9f-4b02-b805-e28a60fc9df4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:42.090072 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-382bde97-de9f-4b02-b805-e28a60fc9df4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:42.225502 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-382bde97-de9f-4b02-b805-e28a60fc9df4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:42.233151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-382bde97-de9f-4b02-b805-e28a60fc9df4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1577 microversion: 2.1 time: 0.157210 Sep 08 14:05:42.233705 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 602/1209] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:42 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:42.325252 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-64c17535-0583-414c-8df3-2fbe3b3d7c91 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:42.325878 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-64c17535-0583-414c-8df3-2fbe3b3d7c91 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:42.332267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c17535-0583-414c-8df3-2fbe3b3d7c91 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:42.332745 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c17535-0583-414c-8df3-2fbe3b3d7c91 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:42.333169 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c17535-0583-414c-8df3-2fbe3b3d7c91 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:42.333898 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c17535-0583-414c-8df3-2fbe3b3d7c91 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:42.334840 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c17535-0583-414c-8df3-2fbe3b3d7c91 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:42.335576 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-64c17535-0583-414c-8df3-2fbe3b3d7c91 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:42.677467 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-64c17535-0583-414c-8df3-2fbe3b3d7c91 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:42.685236 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-64c17535-0583-414c-8df3-2fbe3b3d7c91 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.363900 Sep 08 14:05:42.685820 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 608/1210] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:42 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:43.039998 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-2f09f244-719a-4b4c-adc8-8f4ecfff0627 req-5b9e70a8-6274-4459-8a14-db1b6b3903a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0fbbab-644f-4d57-b4bf-644204a5b26f", "name": "network-vif-deleted", "tag": "07945f23-93ca-4174-93c3-7352e02ec6a5"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:43.050670 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2f09f244-719a-4b4c-adc8-8f4ecfff0627 req-5b9e70a8-6274-4459-8a14-db1b6b3903a8 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:43.051145 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2f09f244-719a-4b4c-adc8-8f4ecfff0627 req-5b9e70a8-6274-4459-8a14-db1b6b3903a8 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:43.051574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-2f09f244-719a-4b4c-adc8-8f4ecfff0627 req-5b9e70a8-6274-4459-8a14-db1b6b3903a8 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:43.064500 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-2f09f244-719a-4b4c-adc8-8f4ecfff0627 req-5b9e70a8-6274-4459-8a14-db1b6b3903a8 service nova] Creating event network-vif-deleted:07945f23-93ca-4174-93c3-7352e02ec6a5 for instance 6c0fbbab-644f-4d57-b4bf-644204a5b26f on hv-cinder-82002 Sep 08 14:05:43.069310 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-2f09f244-719a-4b4c-adc8-8f4ecfff0627 req-5b9e70a8-6274-4459-8a14-db1b6b3903a8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033750 Sep 08 14:05:43.070132 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 603/1211] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:43.256903 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-31ab8a13-6ec4-415d-adc7-56eb9fee5f24 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:43.257463 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-31ab8a13-6ec4-415d-adc7-56eb9fee5f24 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:43.263384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ab8a13-6ec4-415d-adc7-56eb9fee5f24 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:43.263864 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ab8a13-6ec4-415d-adc7-56eb9fee5f24 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:43.264294 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ab8a13-6ec4-415d-adc7-56eb9fee5f24 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:43.264975 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ab8a13-6ec4-415d-adc7-56eb9fee5f24 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:43.265426 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ab8a13-6ec4-415d-adc7-56eb9fee5f24 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:43.265875 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-31ab8a13-6ec4-415d-adc7-56eb9fee5f24 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:43.327492 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-31ab8a13-6ec4-415d-adc7-56eb9fee5f24 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76a9dc3ddb144e599a2856fce8dc339d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d114fd258a4306b4c0665df90ae4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:43.336008 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-31ab8a13-6ec4-415d-adc7-56eb9fee5f24 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 200 len: 1224 microversion: 2.1 time: 0.083448 Sep 08 14:05:43.336627 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 609/1212] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:43 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:43.709220 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-13528f51-4263-4028-8028-a63f5144d878 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:43.709965 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-13528f51-4263-4028-8028-a63f5144d878 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:43.716229 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13528f51-4263-4028-8028-a63f5144d878 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:43.716710 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13528f51-4263-4028-8028-a63f5144d878 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:43.717142 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13528f51-4263-4028-8028-a63f5144d878 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:43.717854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13528f51-4263-4028-8028-a63f5144d878 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:43.718301 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13528f51-4263-4028-8028-a63f5144d878 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:43.718718 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-13528f51-4263-4028-8028-a63f5144d878 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:43.853124 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-13528f51-4263-4028-8028-a63f5144d878 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:43.860739 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-13528f51-4263-4028-8028-a63f5144d878 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.156195 Sep 08 14:05:43.861306 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 604/1213] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:43 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:44.359255 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:44.359899 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 6c0fbbab-644f-4d57-b4bf-644204a5b26f] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:44.366267 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.366743 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.367169 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.367897 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.368339 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.368749 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.382486 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] HTTP exception thrown: Instance 6c0fbbab-644f-4d57-b4bf-644204a5b26f could not be found. Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Request method failure captured: Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f HTTP/1.1 Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfTEfgn9hqwcQPTZjtjIi_eZbPKBSZw4vbtM7d4LDTgTlcj95rmQME9s9ofUwi3UgHEetwgR-HYhHHMhkou9zN7Go1J_4TsEl0CStTihhXJBw0-4FiYZ7_Xbzi_KVKJVLaXtQ1j1RKE660Xb89-XiiivL_hq3Ec1JfVTeZJOpwvAskc Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 19d114fd258a4306b4c0665df90ae4c7 Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:05:44.384901 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19d114fd258a4306b4c0665df90ae4c7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 19d114fd258a4306b4c0665df90ae4c7 Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-TestVolumeBootPattern-572502475-project Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 76a9dc3ddb144e599a2856fce8dc339d Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-TestVolumeBootPattern-572502475-project Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 6c0fbbab-644f-4d57-b4bf-644204a5b26f could not be found. Sep 08 14:05:44.389479 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '6c0fbbab-644f-4d57-b4bf-644204a5b26f'} Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0fbbab-644f-4d57-b4bf-644204a5b26f could not be found. Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:44.390696 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0fbbab-644f-4d57-b4bf-644204a5b26f could not be found. Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0fbbab-644f-4d57-b4bf-644204a5b26f could not be found. Sep 08 14:05:44.392930 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.394505 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Returning 404 to user: Instance 6c0fbbab-644f-4d57-b4bf-644204a5b26f could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:44.394505 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-823b6dc6-1d6d-4c14-999d-0a6976292ba7 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f" status: 404 len: 111 microversion: 2.1 time: 0.030216 Sep 08 14:05:44.394505 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 610/1214] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:44 2022] GET /compute/v2.1/servers/6c0fbbab-644f-4d57-b4bf-644204a5b26f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:44.831093 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:44.831636 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:44.838073 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.838554 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.838993 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.839686 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.840142 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.840562 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.854156 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.wsgi [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] HTTP exception thrown: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Request method failure captured: Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: request: DELETE /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf HTTP/1.1 Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept: application/json Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Accept-Encoding: identity Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Connection: close Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Length: 0 Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Content-Type: application/json Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Host: 10.222.0.55 Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: Openstack-System-Scope: None Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Auth-Token: gAAAAABjGfTEfgn9hqwcQPTZjtjIi_eZbPKBSZw4vbtM7d4LDTgTlcj95rmQME9s9ofUwi3UgHEetwgR-HYhHHMhkou9zN7Go1J_4TsEl0CStTihhXJBw0-4FiYZ7_Xbzi_KVKJVLaXtQ1j1RKE660Xb89-XiiivL_hq3Ec1JfVTeZJOpwvAskc Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Id: None Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Domain-Name: None Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Identity-Status: Confirmed Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Is-Admin-Project: True Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Id: default Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Domain-Name: Default Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Id: 19d114fd258a4306b4c0665df90ae4c7 Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Project-Name: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Role: member,reader Sep 08 14:05:44.855854 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Roles: member,reader Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19d114fd258a4306b4c0665df90ae4c7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Id: 19d114fd258a4306b4c0665df90ae4c7 Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-Tenant-Name: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User: tempest-TestVolumeBootPattern-572502475-project Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Id: default Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Domain-Name: Default Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Id: 76a9dc3ddb144e599a2856fce8dc339d Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: X-User-Name: tempest-TestVolumeBootPattern-572502475-project Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: method: > Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: exception: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:05:44.857551 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: action_args: {'id': '335efb35-9bac-46a5-b2d4-4e2936c82aaf'} Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:44.858563 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:05:44.860130 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.862573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Returning 404 to user: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. {{(pid=126920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:44.862573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-4cbe18ad-59f1-409b-99a0-a23592e762c9 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "DELETE /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 404 len: 111 microversion: 2.1 time: 0.030069 Sep 08 14:05:44.862573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 605/1215] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:05:44 2022] DELETE /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:44.866536 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:44.867157 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] [instance: 335efb35-9bac-46a5-b2d4-4e2936c82aaf] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:44.873898 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.874376 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.874815 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.875512 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.875967 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.877972 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.883612 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-d2fbfdf7-da6e-417b-be63-867306a73e85 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:44.884278 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-d2fbfdf7-da6e-417b-be63-867306a73e85 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:44.890324 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2fbfdf7-da6e-417b-be63-867306a73e85 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.890965 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] HTTP exception thrown: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:05:44.891117 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2fbfdf7-da6e-417b-be63-867306a73e85 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.891414 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2fbfdf7-da6e-417b-be63-867306a73e85 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.892116 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2fbfdf7-da6e-417b-be63-867306a73e85 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Request method failure captured: Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf HTTP/1.1 Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfTEfgn9hqwcQPTZjtjIi_eZbPKBSZw4vbtM7d4LDTgTlcj95rmQME9s9ofUwi3UgHEetwgR-HYhHHMhkou9zN7Go1J_4TsEl0CStTihhXJBw0-4FiYZ7_Xbzi_KVKJVLaXtQ1j1RKE660Xb89-XiiivL_hq3Ec1JfVTeZJOpwvAskc Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 19d114fd258a4306b4c0665df90ae4c7 Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:05:44.892640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19d114fd258a4306b4c0665df90ae4c7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19d114fd258a4306b4c0665df90ae4c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 19d114fd258a4306b4c0665df90ae4c7 Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestVolumeBootPattern-572502475 Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-TestVolumeBootPattern-572502475-project Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 76a9dc3ddb144e599a2856fce8dc339d Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-TestVolumeBootPattern-572502475-project Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:05:44.894384 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '335efb35-9bac-46a5-b2d4-4e2936c82aaf'} Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:44.895354 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. Sep 08 14:05:44.896950 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:05:44.898415 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2fbfdf7-da6e-417b-be63-867306a73e85 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.898415 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-d2fbfdf7-da6e-417b-be63-867306a73e85 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.899707 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Returning 404 to user: Instance 335efb35-9bac-46a5-b2d4-4e2936c82aaf could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:44.900747 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-03f637ca-c8f4-4fc1-b803-7b03ef7829cb tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf" status: 404 len: 111 microversion: 2.1 time: 0.038556 Sep 08 14:05:44.901802 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 611/1216] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:44 2022] GET /compute/v2.1/servers/335efb35-9bac-46a5-b2d4-4e2936c82aaf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:45.124604 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-d2fbfdf7-da6e-417b-be63-867306a73e85 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:45.132377 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-d2fbfdf7-da6e-417b-be63-867306a73e85 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.253189 Sep 08 14:05:45.132939 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 606/1217] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:44 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:46.155198 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-69562c43-c78e-4217-8c06-86305e402256 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:46.155916 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-69562c43-c78e-4217-8c06-86305e402256 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:46.163031 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69562c43-c78e-4217-8c06-86305e402256 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:46.163484 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69562c43-c78e-4217-8c06-86305e402256 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:46.164110 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69562c43-c78e-4217-8c06-86305e402256 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:46.164813 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69562c43-c78e-4217-8c06-86305e402256 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:46.165265 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69562c43-c78e-4217-8c06-86305e402256 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:46.165685 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-69562c43-c78e-4217-8c06-86305e402256 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:46.205271 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e6bce74d-03b6-4ddb-8360-c95703f756b4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] Calling method '.version_select at 0x7f5be43ee1f0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:46.233131 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e6bce74d-03b6-4ddb-8360-c95703f756b4 tempest-TestVolumeBootPattern-572502475 tempest-TestVolumeBootPattern-572502475-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-327996144" status: 202 len: 0 microversion: 2.1 time: 0.031476 Sep 08 14:05:46.234219 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 607/1218] 10.222.0.55 () {58 vars in 1260 bytes} [Thu Sep 8 14:05:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-327996144 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:05:46.322352 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-69562c43-c78e-4217-8c06-86305e402256 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:46.330677 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-69562c43-c78e-4217-8c06-86305e402256 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.179323 Sep 08 14:05:46.331233 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 612/1219] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:46 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:47.354584 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-680c7894-68e2-4e62-9c7d-371b0e040c02 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:47.355579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-680c7894-68e2-4e62-9c7d-371b0e040c02 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:47.363123 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-680c7894-68e2-4e62-9c7d-371b0e040c02 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:47.367302 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-680c7894-68e2-4e62-9c7d-371b0e040c02 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:47.367837 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-680c7894-68e2-4e62-9c7d-371b0e040c02 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:47.368656 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-680c7894-68e2-4e62-9c7d-371b0e040c02 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:47.369178 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-680c7894-68e2-4e62-9c7d-371b0e040c02 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:47.369850 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-680c7894-68e2-4e62-9c7d-371b0e040c02 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:47.511781 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-680c7894-68e2-4e62-9c7d-371b0e040c02 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:47.519368 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-680c7894-68e2-4e62-9c7d-371b0e040c02 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.168725 Sep 08 14:05:47.519930 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 608/1220] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:47 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:48.543553 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-43e8f1a9-60c5-4d20-8eeb-98f8e4f9196d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:48.544247 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-43e8f1a9-60c5-4d20-8eeb-98f8e4f9196d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:48.551052 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43e8f1a9-60c5-4d20-8eeb-98f8e4f9196d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:48.551554 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43e8f1a9-60c5-4d20-8eeb-98f8e4f9196d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:48.551980 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43e8f1a9-60c5-4d20-8eeb-98f8e4f9196d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:48.552935 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43e8f1a9-60c5-4d20-8eeb-98f8e4f9196d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:48.553389 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43e8f1a9-60c5-4d20-8eeb-98f8e4f9196d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:48.553847 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-43e8f1a9-60c5-4d20-8eeb-98f8e4f9196d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:48.700292 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-43e8f1a9-60c5-4d20-8eeb-98f8e4f9196d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:48.711104 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-43e8f1a9-60c5-4d20-8eeb-98f8e4f9196d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.171307 Sep 08 14:05:48.726043 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 613/1221] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:48 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:49.735232 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-76bd2b3e-c21a-4e26-9ce2-f5ba754eb3a3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:49.736067 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-76bd2b3e-c21a-4e26-9ce2-f5ba754eb3a3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:49.743228 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76bd2b3e-c21a-4e26-9ce2-f5ba754eb3a3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:49.743782 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76bd2b3e-c21a-4e26-9ce2-f5ba754eb3a3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:49.744317 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76bd2b3e-c21a-4e26-9ce2-f5ba754eb3a3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:49.745081 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76bd2b3e-c21a-4e26-9ce2-f5ba754eb3a3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:49.745602 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76bd2b3e-c21a-4e26-9ce2-f5ba754eb3a3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:49.746406 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-76bd2b3e-c21a-4e26-9ce2-f5ba754eb3a3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:49.878730 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-76bd2b3e-c21a-4e26-9ce2-f5ba754eb3a3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:49.886779 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-76bd2b3e-c21a-4e26-9ce2-f5ba754eb3a3 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.155464 Sep 08 14:05:49.887441 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 609/1222] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:49 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:50.911038 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-7651f966-5114-49ca-89d5-0801b7d3791d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:50.911646 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-7651f966-5114-49ca-89d5-0801b7d3791d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:50.918847 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7651f966-5114-49ca-89d5-0801b7d3791d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:50.919321 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7651f966-5114-49ca-89d5-0801b7d3791d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:50.919748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7651f966-5114-49ca-89d5-0801b7d3791d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:50.920429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7651f966-5114-49ca-89d5-0801b7d3791d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:50.920872 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7651f966-5114-49ca-89d5-0801b7d3791d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:50.921321 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-7651f966-5114-49ca-89d5-0801b7d3791d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:50.941722 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:51.073077 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-7651f966-5114-49ca-89d5-0801b7d3791d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:51.086279 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-7651f966-5114-49ca-89d5-0801b7d3791d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.178802 Sep 08 14:05:51.087421 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 614/1223] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:50 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:52.110997 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f39f9fc0-e70a-486b-910d-c4904b9edc84 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:52.112254 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-f39f9fc0-e70a-486b-910d-c4904b9edc84 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:52.119073 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f39f9fc0-e70a-486b-910d-c4904b9edc84 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:52.119554 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f39f9fc0-e70a-486b-910d-c4904b9edc84 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:52.119989 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f39f9fc0-e70a-486b-910d-c4904b9edc84 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:52.120682 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f39f9fc0-e70a-486b-910d-c4904b9edc84 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:52.121134 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f39f9fc0-e70a-486b-910d-c4904b9edc84 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:52.121560 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-f39f9fc0-e70a-486b-910d-c4904b9edc84 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:52.306470 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-f39f9fc0-e70a-486b-910d-c4904b9edc84 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:52.315297 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f39f9fc0-e70a-486b-910d-c4904b9edc84 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1568 microversion: 2.1 time: 0.209593 Sep 08 14:05:52.315893 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 610/1224] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:52 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:52.343222 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-495c7824-c194-4c1c-b64c-376df633e4a9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:52.344004 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-495c7824-c194-4c1c-b64c-376df633e4a9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:52.356723 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-495c7824-c194-4c1c-b64c-376df633e4a9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:52.357800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-495c7824-c194-4c1c-b64c-376df633e4a9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:52.358429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-495c7824-c194-4c1c-b64c-376df633e4a9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:52.359434 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-495c7824-c194-4c1c-b64c-376df633e4a9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:52.359890 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-495c7824-c194-4c1c-b64c-376df633e4a9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:52.360342 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-495c7824-c194-4c1c-b64c-376df633e4a9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:52.401960 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-495c7824-c194-4c1c-b64c-376df633e4a9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126919) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 14:05:52.505004 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-495c7824-c194-4c1c-b64c-376df633e4a9 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "POST /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832/action" status: 202 len: 0 microversion: 2.1 time: 0.165923 Sep 08 14:05:52.506046 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 615/1225] 10.222.0.55 () {60 vars in 1278 bytes} [Thu Sep 8 14:05:52 2022] POST /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:52.519361 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-ab463e24-4d1a-4b00-b027-740dc41030aa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:52.520099 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-ab463e24-4d1a-4b00-b027-740dc41030aa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:52.535969 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab463e24-4d1a-4b00-b027-740dc41030aa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:52.544165 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab463e24-4d1a-4b00-b027-740dc41030aa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:52.544616 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab463e24-4d1a-4b00-b027-740dc41030aa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:52.545614 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab463e24-4d1a-4b00-b027-740dc41030aa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:52.546557 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab463e24-4d1a-4b00-b027-740dc41030aa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:52.546913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-ab463e24-4d1a-4b00-b027-740dc41030aa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:52.798834 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-ab463e24-4d1a-4b00-b027-740dc41030aa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:52.809360 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-ab463e24-4d1a-4b00-b027-740dc41030aa tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1516 microversion: 2.1 time: 0.293012 Sep 08 14:05:52.810128 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 611/1226] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:52 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1516 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:53.832800 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-837a1671-a721-4865-9282-03b586536733 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:53.833423 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-837a1671-a721-4865-9282-03b586536733 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:53.840671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-837a1671-a721-4865-9282-03b586536733 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:53.841670 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-837a1671-a721-4865-9282-03b586536733 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:53.842316 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-837a1671-a721-4865-9282-03b586536733 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:53.843022 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-837a1671-a721-4865-9282-03b586536733 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:53.843484 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-837a1671-a721-4865-9282-03b586536733 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:53.843924 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-837a1671-a721-4865-9282-03b586536733 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:54.023145 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-837a1671-a721-4865-9282-03b586536733 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:54.032611 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-837a1671-a721-4865-9282-03b586536733 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1516 microversion: 2.1 time: 0.203866 Sep 08 14:05:54.033471 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 616/1227] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:53 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:54.690952 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-3612aed0-0fe6-4e84-8ce7-43c010fc8771 req-ed37c9f9-5184-4781-be0d-c4589609debc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13064b4a-3c9e-4c93-96fe-7779d873e832", "name": "network-vif-unplugged", "status": "completed", "tag": "bd7535b1-15c4-42a1-b1c2-93844a3b30f1"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:54.700864 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3612aed0-0fe6-4e84-8ce7-43c010fc8771 req-ed37c9f9-5184-4781-be0d-c4589609debc service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:54.701341 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3612aed0-0fe6-4e84-8ce7-43c010fc8771 req-ed37c9f9-5184-4781-be0d-c4589609debc service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:54.701790 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-3612aed0-0fe6-4e84-8ce7-43c010fc8771 req-ed37c9f9-5184-4781-be0d-c4589609debc service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:54.712841 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.compute.server_external_events [req-3612aed0-0fe6-4e84-8ce7-43c010fc8771 req-ed37c9f9-5184-4781-be0d-c4589609debc service nova] Unable to find a host for instance 13064b4a-3c9e-4c93-96fe-7779d873e832. Dropping event network-vif-unplugged {{(pid=126920) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 14:05:54.713699 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-3612aed0-0fe6-4e84-8ce7-43c010fc8771 req-ed37c9f9-5184-4781-be0d-c4589609debc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086944 Sep 08 14:05:54.714298 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 612/1228] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 14:05:55.057891 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-5c56503b-fdd4-4fc8-9ed8-4399ec865c6d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:55.058509 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-5c56503b-fdd4-4fc8-9ed8-4399ec865c6d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:55.064911 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c56503b-fdd4-4fc8-9ed8-4399ec865c6d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:55.065393 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c56503b-fdd4-4fc8-9ed8-4399ec865c6d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:55.065855 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c56503b-fdd4-4fc8-9ed8-4399ec865c6d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:55.066550 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c56503b-fdd4-4fc8-9ed8-4399ec865c6d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:55.067001 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c56503b-fdd4-4fc8-9ed8-4399ec865c6d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:55.067425 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-5c56503b-fdd4-4fc8-9ed8-4399ec865c6d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:55.201763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-5c56503b-fdd4-4fc8-9ed8-4399ec865c6d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:55.210431 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-5c56503b-fdd4-4fc8-9ed8-4399ec865c6d tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1516 microversion: 2.1 time: 0.156450 Sep 08 14:05:55.210990 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 617/1229] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:55 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:56.234220 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a2dd869c-5cb0-4d0e-8fa2-52a880eb6666 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:56.234783 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a2dd869c-5cb0-4d0e-8fa2-52a880eb6666 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:56.241174 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2dd869c-5cb0-4d0e-8fa2-52a880eb6666 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.241656 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2dd869c-5cb0-4d0e-8fa2-52a880eb6666 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.242137 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2dd869c-5cb0-4d0e-8fa2-52a880eb6666 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.242832 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2dd869c-5cb0-4d0e-8fa2-52a880eb6666 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.243314 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2dd869c-5cb0-4d0e-8fa2-52a880eb6666 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.243742 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a2dd869c-5cb0-4d0e-8fa2-52a880eb6666 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.374505 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a2dd869c-5cb0-4d0e-8fa2-52a880eb6666 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:56.378042 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:56.383797 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a2dd869c-5cb0-4d0e-8fa2-52a880eb6666 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1516 microversion: 2.1 time: 0.153514 Sep 08 14:05:56.384388 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 613/1230] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:56 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:57.407879 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-e9d7a349-739c-4a73-bb67-22ed00bc1e80 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:57.408473 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-e9d7a349-739c-4a73-bb67-22ed00bc1e80 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:57.415195 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9d7a349-739c-4a73-bb67-22ed00bc1e80 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.415675 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9d7a349-739c-4a73-bb67-22ed00bc1e80 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.416105 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9d7a349-739c-4a73-bb67-22ed00bc1e80 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.416933 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9d7a349-739c-4a73-bb67-22ed00bc1e80 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.417395 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9d7a349-739c-4a73-bb67-22ed00bc1e80 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.418013 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-e9d7a349-739c-4a73-bb67-22ed00bc1e80 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.554869 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-e9d7a349-739c-4a73-bb67-22ed00bc1e80 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:57.562748 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-e9d7a349-739c-4a73-bb67-22ed00bc1e80 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1516 microversion: 2.1 time: 0.158801 Sep 08 14:05:57.563344 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 618/1231] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:57 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:58.590150 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-a9e2a38f-5960-4762-824a-6e8105c1ea47 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:58.590836 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-a9e2a38f-5960-4762-824a-6e8105c1ea47 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:58.598613 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9e2a38f-5960-4762-824a-6e8105c1ea47 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:58.599374 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9e2a38f-5960-4762-824a-6e8105c1ea47 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:58.599875 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9e2a38f-5960-4762-824a-6e8105c1ea47 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:58.600867 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9e2a38f-5960-4762-824a-6e8105c1ea47 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:58.601393 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9e2a38f-5960-4762-824a-6e8105c1ea47 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:58.601985 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-a9e2a38f-5960-4762-824a-6e8105c1ea47 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:58.737594 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-a9e2a38f-5960-4762-824a-6e8105c1ea47 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:58.745527 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-a9e2a38f-5960-4762-824a-6e8105c1ea47 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1574 microversion: 2.1 time: 0.161886 Sep 08 14:05:58.746106 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 614/1232] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:58 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:59.770051 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-a62b44f3-f259-4378-a1cf-3740b7b1bd73 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:59.770671 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-a62b44f3-f259-4378-a1cf-3740b7b1bd73 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:59.777831 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a62b44f3-f259-4378-a1cf-3740b7b1bd73 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:59.778241 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a62b44f3-f259-4378-a1cf-3740b7b1bd73 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:59.778680 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a62b44f3-f259-4378-a1cf-3740b7b1bd73 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:59.779374 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a62b44f3-f259-4378-a1cf-3740b7b1bd73 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:59.779826 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a62b44f3-f259-4378-a1cf-3740b7b1bd73 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:59.780246 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-a62b44f3-f259-4378-a1cf-3740b7b1bd73 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:59.922497 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-a62b44f3-f259-4378-a1cf-3740b7b1bd73 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:59.930294 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-a62b44f3-f259-4378-a1cf-3740b7b1bd73 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1574 microversion: 2.1 time: 0.164253 Sep 08 14:05:59.930863 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 619/1233] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:59 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:00.953834 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-1aad297c-7d02-41a6-bb3f-b46fd814c6cc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:00.954449 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-1aad297c-7d02-41a6-bb3f-b46fd814c6cc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:00.961006 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1aad297c-7d02-41a6-bb3f-b46fd814c6cc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.961512 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1aad297c-7d02-41a6-bb3f-b46fd814c6cc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.961973 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1aad297c-7d02-41a6-bb3f-b46fd814c6cc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:00.962659 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1aad297c-7d02-41a6-bb3f-b46fd814c6cc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.963102 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1aad297c-7d02-41a6-bb3f-b46fd814c6cc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.963546 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-1aad297c-7d02-41a6-bb3f-b46fd814c6cc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.093719 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-1aad297c-7d02-41a6-bb3f-b46fd814c6cc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:01.102015 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-1aad297c-7d02-41a6-bb3f-b46fd814c6cc tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1574 microversion: 2.1 time: 0.152084 Sep 08 14:06:01.102583 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 615/1234] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:00 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:02.125245 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-63393546-648f-4cff-bf5f-64dfaf030a2b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:02.125877 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-63393546-648f-4cff-bf5f-64dfaf030a2b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:02.128175 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:02.134100 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63393546-648f-4cff-bf5f-64dfaf030a2b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.134573 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63393546-648f-4cff-bf5f-64dfaf030a2b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.135000 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63393546-648f-4cff-bf5f-64dfaf030a2b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.135683 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63393546-648f-4cff-bf5f-64dfaf030a2b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.136130 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63393546-648f-4cff-bf5f-64dfaf030a2b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.136549 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-63393546-648f-4cff-bf5f-64dfaf030a2b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.270082 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-63393546-648f-4cff-bf5f-64dfaf030a2b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:02.277786 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-63393546-648f-4cff-bf5f-64dfaf030a2b tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1574 microversion: 2.1 time: 0.156401 Sep 08 14:06:02.278351 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 620/1235] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:02 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:03.300259 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-b9a8328f-2be3-431c-b871-93e965782510 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:03.300865 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-b9a8328f-2be3-431c-b871-93e965782510 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:03.303256 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:03.309366 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9a8328f-2be3-431c-b871-93e965782510 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:03.309885 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9a8328f-2be3-431c-b871-93e965782510 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:03.310320 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9a8328f-2be3-431c-b871-93e965782510 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:03.311013 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9a8328f-2be3-431c-b871-93e965782510 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:03.311491 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9a8328f-2be3-431c-b871-93e965782510 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:03.311913 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-b9a8328f-2be3-431c-b871-93e965782510 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:03.444574 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-b9a8328f-2be3-431c-b871-93e965782510 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:03.452166 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-b9a8328f-2be3-431c-b871-93e965782510 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1574 microversion: 2.1 time: 0.155706 Sep 08 14:06:03.452733 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 616/1236] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:03 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:04.475132 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-12051a57-f410-4624-8774-8f7a26f39245 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:04.475740 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-12051a57-f410-4624-8774-8f7a26f39245 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:04.481967 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12051a57-f410-4624-8774-8f7a26f39245 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.482445 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12051a57-f410-4624-8774-8f7a26f39245 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.482873 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12051a57-f410-4624-8774-8f7a26f39245 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:04.483556 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12051a57-f410-4624-8774-8f7a26f39245 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.484004 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12051a57-f410-4624-8774-8f7a26f39245 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.484423 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-12051a57-f410-4624-8774-8f7a26f39245 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:04.616953 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-12051a57-f410-4624-8774-8f7a26f39245 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:04.624763 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-12051a57-f410-4624-8774-8f7a26f39245 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1574 microversion: 2.1 time: 0.153964 Sep 08 14:06:04.625378 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 621/1237] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:04 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:05.647664 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-81f4c199-369a-4c97-b79d-7d2488f71e0a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:05.648274 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-81f4c199-369a-4c97-b79d-7d2488f71e0a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:05.654122 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81f4c199-369a-4c97-b79d-7d2488f71e0a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:05.654599 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81f4c199-369a-4c97-b79d-7d2488f71e0a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:05.655031 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81f4c199-369a-4c97-b79d-7d2488f71e0a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:05.655713 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81f4c199-369a-4c97-b79d-7d2488f71e0a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:05.656161 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81f4c199-369a-4c97-b79d-7d2488f71e0a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:05.656579 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-81f4c199-369a-4c97-b79d-7d2488f71e0a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:05.789547 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-81f4c199-369a-4c97-b79d-7d2488f71e0a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:05.797211 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-81f4c199-369a-4c97-b79d-7d2488f71e0a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1574 microversion: 2.1 time: 0.153627 Sep 08 14:06:05.797781 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 617/1238] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:05 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:06.820377 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-f24ce192-7285-4d32-b5f4-1d9dfdad2503 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:06.820994 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-f24ce192-7285-4d32-b5f4-1d9dfdad2503 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:06.827626 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f24ce192-7285-4d32-b5f4-1d9dfdad2503 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.828108 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f24ce192-7285-4d32-b5f4-1d9dfdad2503 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.828538 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f24ce192-7285-4d32-b5f4-1d9dfdad2503 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.829235 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f24ce192-7285-4d32-b5f4-1d9dfdad2503 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.829681 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f24ce192-7285-4d32-b5f4-1d9dfdad2503 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.830131 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-f24ce192-7285-4d32-b5f4-1d9dfdad2503 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.960794 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-f24ce192-7285-4d32-b5f4-1d9dfdad2503 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:06.968780 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-f24ce192-7285-4d32-b5f4-1d9dfdad2503 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1574 microversion: 2.1 time: 0.152746 Sep 08 14:06:06.969349 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 622/1239] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:06 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:07.992535 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-79541ce2-7cf1-440b-b632-f628d05ed4f8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:07.993194 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-79541ce2-7cf1-440b-b632-f628d05ed4f8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:07.999644 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79541ce2-7cf1-440b-b632-f628d05ed4f8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.000128 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79541ce2-7cf1-440b-b632-f628d05ed4f8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.000561 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79541ce2-7cf1-440b-b632-f628d05ed4f8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:08.001252 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79541ce2-7cf1-440b-b632-f628d05ed4f8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.001779 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79541ce2-7cf1-440b-b632-f628d05ed4f8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.002151 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-79541ce2-7cf1-440b-b632-f628d05ed4f8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:08.128969 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-79541ce2-7cf1-440b-b632-f628d05ed4f8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:08.137100 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-79541ce2-7cf1-440b-b632-f628d05ed4f8 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1574 microversion: 2.1 time: 0.149315 Sep 08 14:06:08.141213 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 618/1240] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:07 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:08.764146 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-96d68d52-9644-42f4-8245-54c0ccfac9da req-7f5f35c1-cb5a-4200-8966-1d342a633856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13064b4a-3c9e-4c93-96fe-7779d873e832", "name": "network-vif-plugged", "status": "completed", "tag": "bd7535b1-15c4-42a1-b1c2-93844a3b30f1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:08.776638 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-96d68d52-9644-42f4-8245-54c0ccfac9da req-7f5f35c1-cb5a-4200-8966-1d342a633856 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.777112 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-96d68d52-9644-42f4-8245-54c0ccfac9da req-7f5f35c1-cb5a-4200-8966-1d342a633856 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.777530 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-96d68d52-9644-42f4-8245-54c0ccfac9da req-7f5f35c1-cb5a-4200-8966-1d342a633856 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:08.788382 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-96d68d52-9644-42f4-8245-54c0ccfac9da req-7f5f35c1-cb5a-4200-8966-1d342a633856 service nova] Creating event network-vif-plugged:bd7535b1-15c4-42a1-b1c2-93844a3b30f1 for instance 13064b4a-3c9e-4c93-96fe-7779d873e832 on hv-cinder-82002 Sep 08 14:06:08.793313 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-96d68d52-9644-42f4-8245-54c0ccfac9da req-7f5f35c1-cb5a-4200-8966-1d342a633856 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032824 Sep 08 14:06:08.794245 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 623/1241] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:09.161473 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-e455b00d-72df-462b-ad89-1c472e5e9e4c tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:09.162113 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-e455b00d-72df-462b-ad89-1c472e5e9e4c tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:09.168634 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e455b00d-72df-462b-ad89-1c472e5e9e4c tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.169143 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e455b00d-72df-462b-ad89-1c472e5e9e4c tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:09.169586 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e455b00d-72df-462b-ad89-1c472e5e9e4c tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.170305 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e455b00d-72df-462b-ad89-1c472e5e9e4c tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.170759 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e455b00d-72df-462b-ad89-1c472e5e9e4c tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:09.171184 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-e455b00d-72df-462b-ad89-1c472e5e9e4c tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.300206 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-e455b00d-72df-462b-ad89-1c472e5e9e4c tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:09.308350 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-e455b00d-72df-462b-ad89-1c472e5e9e4c tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1574 microversion: 2.1 time: 0.150785 Sep 08 14:06:09.308925 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 619/1242] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:09 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:10.334035 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-0a935cbf-301f-4ce6-8bca-38e4b14f1d2f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:10.334644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-0a935cbf-301f-4ce6-8bca-38e4b14f1d2f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:10.342442 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a935cbf-301f-4ce6-8bca-38e4b14f1d2f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:10.342912 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a935cbf-301f-4ce6-8bca-38e4b14f1d2f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:10.343335 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a935cbf-301f-4ce6-8bca-38e4b14f1d2f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:10.344013 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a935cbf-301f-4ce6-8bca-38e4b14f1d2f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:10.344452 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a935cbf-301f-4ce6-8bca-38e4b14f1d2f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:10.344864 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-0a935cbf-301f-4ce6-8bca-38e4b14f1d2f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:10.476640 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-0a935cbf-301f-4ce6-8bca-38e4b14f1d2f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:10.484283 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-0a935cbf-301f-4ce6-8bca-38e4b14f1d2f tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1574 microversion: 2.1 time: 0.156242 Sep 08 14:06:10.484839 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 624/1243] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:10 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:11.506880 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-52768b34-2fdf-44d6-a908-08a3bd7b857a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:11.507573 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-52768b34-2fdf-44d6-a908-08a3bd7b857a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:11.514023 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52768b34-2fdf-44d6-a908-08a3bd7b857a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.514502 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52768b34-2fdf-44d6-a908-08a3bd7b857a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.514933 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52768b34-2fdf-44d6-a908-08a3bd7b857a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.515622 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52768b34-2fdf-44d6-a908-08a3bd7b857a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.516073 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52768b34-2fdf-44d6-a908-08a3bd7b857a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.516497 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-52768b34-2fdf-44d6-a908-08a3bd7b857a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.643865 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-52768b34-2fdf-44d6-a908-08a3bd7b857a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:11.651999 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-52768b34-2fdf-44d6-a908-08a3bd7b857a tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1561 microversion: 2.1 time: 0.148962 Sep 08 14:06:11.652564 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 620/1244] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:11 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:27.052936 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_api:SELECT=9 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:27.053555 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-093933b3-9617-4487-8942-e4f0c46c29d5 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:27.054297 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-093933b3-9617-4487-8942-e4f0c46c29d5 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:27.055224 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG dbcounter [-] [126920] Writing DB stats nova_cell1:SELECT=42 {{(pid=126920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:27.056605 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_api:SELECT=9 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:27.057512 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG dbcounter [-] [126919] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:27.059984 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [req-55d63792-f4a8-4995-9b45-953967dbdf12 req-87723656-1137-402b-ba00-9c0eb7f203b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13064b4a-3c9e-4c93-96fe-7779d873e832", "tag": "bd7535b1-15c4-42a1-b1c2-93844a3b30f1"}]} {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:27.064920 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093933b3-9617-4487-8942-e4f0c46c29d5 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.065475 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093933b3-9617-4487-8942-e4f0c46c29d5 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.065995 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093933b3-9617-4487-8942-e4f0c46c29d5 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.066760 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093933b3-9617-4487-8942-e4f0c46c29d5 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.067272 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093933b3-9617-4487-8942-e4f0c46c29d5 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.067755 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-093933b3-9617-4487-8942-e4f0c46c29d5 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.071363 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55d63792-f4a8-4995-9b45-953967dbdf12 req-87723656-1137-402b-ba00-9c0eb7f203b3 service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.071845 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55d63792-f4a8-4995-9b45-953967dbdf12 req-87723656-1137-402b-ba00-9c0eb7f203b3 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.072282 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [req-55d63792-f4a8-4995-9b45-953967dbdf12 req-87723656-1137-402b-ba00-9c0eb7f203b3 service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.086880 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.compute.server_external_events [req-55d63792-f4a8-4995-9b45-953967dbdf12 req-87723656-1137-402b-ba00-9c0eb7f203b3 service nova] Creating event network-changed:bd7535b1-15c4-42a1-b1c2-93844a3b30f1 for instance 13064b4a-3c9e-4c93-96fe-7779d873e832 on hv-cinder-82002 Sep 08 14:07:27.092543 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [req-55d63792-f4a8-4995-9b45-953967dbdf12 req-87723656-1137-402b-ba00-9c0eb7f203b3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041203 Sep 08 14:07:27.093383 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 621/1245] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:27.096233 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-093933b3-9617-4487-8942-e4f0c46c29d5 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Going to try to terminate instance {{(pid=126919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:07:27.179734 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-093933b3-9617-4487-8942-e4f0c46c29d5 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "DELETE /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 204 len: 0 microversion: 2.1 time: 0.130290 Sep 08 14:07:27.180644 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 625/1246] 10.222.0.55 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:27 2022] DELETE /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:07:27.189487 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-dc3d2ea5-36d9-405d-a3ee-180f8f08cce7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:27.190501 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-dc3d2ea5-36d9-405d-a3ee-180f8f08cce7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:27.197893 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ea5-36d9-405d-a3ee-180f8f08cce7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.198599 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ea5-36d9-405d-a3ee-180f8f08cce7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.199436 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ea5-36d9-405d-a3ee-180f8f08cce7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.200145 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ea5-36d9-405d-a3ee-180f8f08cce7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.200602 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ea5-36d9-405d-a3ee-180f8f08cce7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.201029 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-dc3d2ea5-36d9-405d-a3ee-180f8f08cce7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.332817 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-dc3d2ea5-36d9-405d-a3ee-180f8f08cce7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:27.341097 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-dc3d2ea5-36d9-405d-a3ee-180f8f08cce7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.156270 Sep 08 14:07:27.341943 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 622/1247] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:27 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:28.365048 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-9a2c9c43-0c04-4ad9-a95e-1b7dcd328405 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:28.365778 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-9a2c9c43-0c04-4ad9-a95e-1b7dcd328405 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:28.372686 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2c9c43-0c04-4ad9-a95e-1b7dcd328405 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.373162 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2c9c43-0c04-4ad9-a95e-1b7dcd328405 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.373600 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2c9c43-0c04-4ad9-a95e-1b7dcd328405 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.374390 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2c9c43-0c04-4ad9-a95e-1b7dcd328405 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.374839 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2c9c43-0c04-4ad9-a95e-1b7dcd328405 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.375260 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-9a2c9c43-0c04-4ad9-a95e-1b7dcd328405 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.574996 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.policy [None req-9a2c9c43-0c04-4ad9-a95e-1b7dcd328405 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:28.582782 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-9a2c9c43-0c04-4ad9-a95e-1b7dcd328405 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1567 microversion: 2.1 time: 0.221996 Sep 08 14:07:28.583407 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 626/1248] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:28 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:29.606395 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-abd068b7-b19f-42da-9794-19f2d98e96c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:29.607019 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.compute.api [None req-abd068b7-b19f-42da-9794-19f2d98e96c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126920) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:29.613902 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd068b7-b19f-42da-9794-19f2d98e96c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.614386 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd068b7-b19f-42da-9794-19f2d98e96c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.614825 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd068b7-b19f-42da-9794-19f2d98e96c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.616215 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd068b7-b19f-42da-9794-19f2d98e96c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.616895 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd068b7-b19f-42da-9794-19f2d98e96c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.617334 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG oslo_concurrency.lockutils [None req-abd068b7-b19f-42da-9794-19f2d98e96c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.650544 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [req-776c4e33-ac74-4363-b7e0-1f76ca992500 req-7a0bd25d-4f33-4f1f-9b78-424e6f93862a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13064b4a-3c9e-4c93-96fe-7779d873e832", "name": "network-vif-deleted", "tag": "bd7535b1-15c4-42a1-b1c2-93844a3b30f1"}]} {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:29.661886 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-776c4e33-ac74-4363-b7e0-1f76ca992500 req-7a0bd25d-4f33-4f1f-9b78-424e6f93862a service nova] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.662365 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-776c4e33-ac74-4363-b7e0-1f76ca992500 req-7a0bd25d-4f33-4f1f-9b78-424e6f93862a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.662794 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [req-776c4e33-ac74-4363-b7e0-1f76ca992500 req-7a0bd25d-4f33-4f1f-9b78-424e6f93862a service nova] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.675106 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.compute.server_external_events [req-776c4e33-ac74-4363-b7e0-1f76ca992500 req-7a0bd25d-4f33-4f1f-9b78-424e6f93862a service nova] Creating event network-vif-deleted:bd7535b1-15c4-42a1-b1c2-93844a3b30f1 for instance 13064b4a-3c9e-4c93-96fe-7779d873e832 on hv-cinder-82002 Sep 08 14:07:29.680616 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [req-776c4e33-ac74-4363-b7e0-1f76ca992500 req-7a0bd25d-4f33-4f1f-9b78-424e6f93862a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034506 Sep 08 14:07:29.681974 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 627/1249] 10.222.0.55 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:29.692845 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.policy [None req-abd068b7-b19f-42da-9794-19f2d98e96c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39393f5448ed4c489ae1459d251f50d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcae1b090af440f836b18a7bb000c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126920) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:29.701080 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-abd068b7-b19f-42da-9794-19f2d98e96c7 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 200 len: 1381 microversion: 2.1 time: 0.098797 Sep 08 14:07:29.701631 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 623/1250] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:29 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 1381 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:30.724865 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '>' {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:30.725552 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.compute.api [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] [instance: 13064b4a-3c9e-4c93-96fe-7779d873e832] Fetching instance by UUID {{(pid=126919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:30.732078 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.732556 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.732985 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.733694 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Acquiring lock "55c333e2-b047-4e60-8a00-16984688bbb6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.734175 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.734600 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG oslo_concurrency.lockutils [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Lock "55c333e2-b047-4e60-8a00-16984688bbb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.748194 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.wsgi [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] HTTP exception thrown: Instance 13064b4a-3c9e-4c93-96fe-7779d873e832 could not be found. Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Request method failure captured: Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: request: GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 HTTP/1.1 Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept: application/json Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Accept-Encoding: identity Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Connection: close Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Length: 0 Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Content-Type: application/json Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Host: 10.222.0.55 Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: Openstack-System-Scope: None Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Auth-Token: gAAAAABjGfX5Y-RkHs_SMnBG7D-53rCvtpJ3O3QsMYZHyhDyDqCeu4rSGzCyZCV-3m0Sxw_zdCLu6iFRaAelIdIMdtRrnZQz6pp3TCNL6gLA6u2w27Zh2uBNttDjrNiE15FIPOAOvr_7L_eoJpsdU0oh2QC1k7CqImH6ySYCQIOZlDLP8oZfOrs Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Id: None Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Domain-Name: None Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Identity-Status: Confirmed Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Is-Admin-Project: True Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Id: default Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Domain-Name: Default Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Id: 1dcae1b090af440f836b18a7bb000c27 Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Project-Name: tempest-TestShelveInstance-730545061 Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Role: member,reader Sep 08 14:07:30.749822 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Roles: member,reader Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1dcae1b090af440f836b18a7bb000c27", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1dcae1b090af440f836b18a7bb000c27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1dcae1b090af440f836b18a7bb000c27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1dcae1b090af440f836b18a7bb000c27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}] Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant: tempest-TestShelveInstance-730545061 Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Id: 1dcae1b090af440f836b18a7bb000c27 Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-Tenant-Name: tempest-TestShelveInstance-730545061 Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User: tempest-TestShelveInstance-730545061-project Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Id: default Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Domain-Name: Default Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Id: 39393f5448ed4c489ae1459d251f50d0 Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: X-User-Name: tempest-TestShelveInstance-730545061-project Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: method: > Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: exception: Instance 13064b4a-3c9e-4c93-96fe-7779d873e832 could not be found. Sep 08 14:07:30.751570 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: action_args: {'id': '13064b4a-3c9e-4c93-96fe-7779d873e832'} Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: {{(pid=126919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13064b4a-3c9e-4c93-96fe-7779d873e832 could not be found. Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:30.752591 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13064b4a-3c9e-4c93-96fe-7779d873e832 could not be found. Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13064b4a-3c9e-4c93-96fe-7779d873e832 could not be found. Sep 08 14:07:30.754429 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: ERROR nova.api.openstack.wsgi Sep 08 14:07:30.755700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: DEBUG nova.api.openstack.wsgi [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Returning 404 to user: Instance 13064b4a-3c9e-4c93-96fe-7779d873e832 could not be found. {{(pid=126919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:30.755700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: INFO nova.api.openstack.requestlog [None req-ac7522d1-81cc-48d1-868a-71bf86e41509 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832" status: 404 len: 111 microversion: 2.1 time: 0.030519 Sep 08 14:07:30.755700 dv-cinder-820027-24-iscsi devstack@n-api.service[126919]: [pid: 126919|app: 0|req: 628/1251] 10.222.0.55 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:30 2022] GET /compute/v2.1/servers/13064b4a-3c9e-4c93-96fe-7779d873e832 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:30.913093 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: DEBUG nova.api.openstack.wsgi [None req-f215581a-aecc-410f-bc2c-68b1ecf27037 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] Calling method '.version_select at 0x7f5be453f5e0>' {{(pid=126920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:30.932502 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: INFO nova.api.openstack.requestlog [None req-f215581a-aecc-410f-bc2c-68b1ecf27037 tempest-TestShelveInstance-730545061 tempest-TestShelveInstance-730545061-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-336262040" status: 202 len: 0 microversion: 2.1 time: 0.023220 Sep 08 14:07:30.933259 dv-cinder-820027-24-iscsi devstack@n-api.service[126920]: [pid: 126920|app: 0|req: 624/1252] 10.222.0.55 () {58 vars in 1251 bytes} [Thu Sep 8 14:07:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-336262040 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)